2024-04-25T20:30:40.505 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T20:30:40.505 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} --verbose --owner scheduled_leonidus@teuthology --name leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646 -- /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/orig.config.yaml 2024-04-25T20:30:40.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T20:30:40.670 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646 branch: wip-lusov-quiescer description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7673646' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: e221b808d285b9d02e54cc10c53c84188e8e41e3 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2919 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_e221b808d285b9d02e54cc10c53c84188e8e41e3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: e221b808d285b9d02e54cc10c53c84188e8e41e3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHVyYzIBmhSVGledx7pUcHPeqlQFNBbvieUOSJKZsakKxf/zNcI1YCnFjSRA5aK5GpQEPCUr23aW07e0iROJ/o= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4hl/6deenXHtLrURRmuOXd22ya16P72rhBfmbIerIuwXO1IJaqNi4lt2Bwyxxz1TE0AG0seBDLDMhoXUC8z7c= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNA+Zm4RI6vHni9ouYb1YC+DUoMbG7G0vwXYZHD3SROH9pEmiIBq9tlTJMYxT0y6jd64NksKW3g5QlbNSJECvJo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_19:59:35 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T20:30:40.671 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_e221b808d285b9d02e54cc10c53c84188e8e41e3/qa; will attempt to use it 2024-04-25T20:30:40.671 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_e221b808d285b9d02e54cc10c53c84188e8e41e3/qa/tasks 2024-04-25T20:30:40.672 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T20:30:40.673 INFO:teuthology.task.internal:Checking packages... 2024-04-25T20:30:40.697 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T20:30:40.697 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T20:30:40.698 INFO:teuthology.packaging:ref: None 2024-04-25T20:30:40.698 INFO:teuthology.packaging:tag: None 2024-04-25T20:30:40.698 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T20:30:40.698 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:30:40.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T20:30:40.931 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-25T20:30:40.933 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T20:30:40.939 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T20:30:40.939 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T20:30:40.946 INFO:teuthology.task.internal:Saving configuration 2024-04-25T20:30:40.966 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T20:30:40.973 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T20:30:40.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 20:25:38.229065', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHVyYzIBmhSVGledx7pUcHPeqlQFNBbvieUOSJKZsakKxf/zNcI1YCnFjSRA5aK5GpQEPCUr23aW07e0iROJ/o='} 2024-04-25T20:30:41.005 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 20:25:38.230817', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4hl/6deenXHtLrURRmuOXd22ya16P72rhBfmbIerIuwXO1IJaqNi4lt2Bwyxxz1TE0AG0seBDLDMhoXUC8z7c='} 2024-04-25T20:30:41.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 20:25:38.232349', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNA+Zm4RI6vHni9ouYb1YC+DUoMbG7G0vwXYZHD3SROH9pEmiIBq9tlTJMYxT0y6jd64NksKW3g5QlbNSJECvJo='} 2024-04-25T20:30:41.023 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T20:30:41.029 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-25T20:30:41.029 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-25T20:30:41.029 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-25T20:30:41.029 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T20:30:41.121 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc81d5ac0d0>, signals=[15]) 2024-04-25T20:30:41.121 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T20:30:41.129 INFO:teuthology.task.internal:Opening connections... 2024-04-25T20:30:41.129 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:30:41.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:30:41.209 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T20:30:41.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:30:41.283 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T20:30:41.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:30:41.359 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T20:30:41.367 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-25T20:30:41.385 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-25T20:30:41.385 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-04-25T20:30:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T20:30:41.444 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-25T20:30:41.444 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T20:30:41.444 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T20:30:41.444 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T20:30:41.444 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-25T20:30:41.479 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-25T20:30:41.497 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-25T20:30:41.497 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-25T20:30:41.554 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-25T20:30:41.554 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T20:30:41.555 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T20:30:41.556 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-25T20:30:41.579 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-25T20:30:41.596 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-25T20:30:41.597 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T20:30:41.654 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T20:30:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T20:30:41.655 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-25T20:30:41.679 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T20:30:41.689 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T20:30:41.696 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T20:30:41.696 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-25T20:30:41.699 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-25T20:30:41.701 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-25T20:30:41.718 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T20:30:41.724 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T20:30:41.724 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-25T20:30:41.756 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-25T20:30:41.758 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-25T20:30:41.864 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T20:30:41.935 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T20:30:41.948 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T20:30:41.948 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-25T20:30:41.948 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-25T20:30:41.949 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T20:30:41.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:30:41.966 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-25T20:30:42.025 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-437.el9.x86_64 2024-04-25T20:30:42.025 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-437.el9.x86_64 2024-04-25T20:30:42.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-04-25T20:30:44.442 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T20:30:46.334 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T20:30:51.143 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.2 MB 00:01 2024-04-25T20:30:52.666 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-25T20:31:06.008 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 21 MB 00:13 2024-04-25T20:31:11.391 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-25T20:31:13.372 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T20:31:13.372 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T20:31:13.479 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T20:31:13.480 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-04-25T20:31:13.480 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T20:31:13.582 DEBUG:teuthology.orchestra.run.smithi043:> echo no | sudo yum reinstall kernel || true 2024-04-25T20:31:14.103 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:31:11 PM UTC. 2024-04-25T20:31:14.233 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalling: 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 255 k 2024-04-25T20:31:14.245 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 0 2024-04-25T20:31:14.246 INFO:teuthology.orchestra.run.smithi043.stderr:Operation aborted. 2024-04-25T20:31:14.303 INFO:teuthology.orchestra.run.smithi043.stdout:Is this ok [y/N]: 2024-04-25T20:31:14.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum reinstall -y kernel || true 2024-04-25T20:31:14.817 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:31:11 PM UTC. 2024-04-25T20:31:14.939 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalling: 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T20:31:14.940 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 255 k 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 0 2024-04-25T20:31:14.941 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-25T20:31:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T20:31:15.451 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T20:31:15.452 INFO:teuthology.orchestra.run.smithi043.stdout:Total 498 kB/s | 255 kB 00:00 2024-04-25T20:31:15.470 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-25T20:31:15.687 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-25T20:31:15.688 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-25T20:31:15.693 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-25T20:31:15.693 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-25T20:31:15.839 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-25T20:31:15.919 INFO:teuthology.orchestra.run.smithi043.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T20:31:15.919 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T20:31:16.585 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T20:31:16.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout:Reinstalled: 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:31:17.304 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T20:31:17.473 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T20:31:17.522 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T20:31:17.522 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T20:31:17.522 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T20:31:17.522 DEBUG:teuthology.parallel:result is None 2024-04-25T20:31:17.523 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T20:31:17.529 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T20:31:17.529 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T20:31:17.532 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T20:31:17.534 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T20:31:17.552 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T20:31:17.561 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T20:31:17.575 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T20:31:17.575 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T20:31:17.587 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T20:31:17.592 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T20:31:17.697 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T20:31:17.708 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T20:31:17.708 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T20:31:17.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:31:17.724 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T20:31:17.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:31:17.741 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T20:31:17.744 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T20:31:17.767 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T20:31:17.797 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.813 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.831 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.835 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.850 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.855 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T20:31:17.857 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T20:31:17.864 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T20:31:17.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T20:31:17.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T20:31:17.869 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T20:31:17.895 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T20:31:17.907 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T20:31:17.908 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T20:31:17.933 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T20:31:17.936 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T20:31:17.951 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.073 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.194 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:31:18.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T20:31:18.258 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.348 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.472 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:31:18.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T20:31:18.536 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T20:31:18.634 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T20:31:18.759 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:31:18.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T20:31:18.824 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-25T20:31:18.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-25T20:31:18.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-25T20:31:18.862 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T20:31:18.863 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T20:31:18.900 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T20:31:19.377 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T20:31:19.384 INFO:teuthology.task.internal:Starting timer... 2024-04-25T20:31:19.384 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T20:31:19.396 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T20:31:19.405 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T20:31:19.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-04-25T20:31:19.482 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-04-25T20:31:19.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-04-25T20:31:19.537 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-04-25T20:31:19.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-25T20:31:19.618 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-25T20:31:19.620 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T20:31:19.620 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-04-25T20:31:19.641 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-04-25T20:31:19.642 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-04-25T20:31:19.663 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-04-25T20:31:19.663 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-25T20:31:19.694 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-25T20:31:19.694 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-25T20:31:19.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T20:31:19.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:31:19.721 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T20:31:19.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:31:19.748 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T20:31:19.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:31:19.776 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T20:31:19.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-04-25T20:31:19.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-04-25T20:31:19.844 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-25T20:31:19.871 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T20:31:19.881 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T20:31:19.886 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T20:31:20.031 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T20:31:20.046 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T20:31:20.048 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi112.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T20:35:19.902 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-25T20:35:19.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T20:35:19.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:35:19.986 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-25T20:35:20.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-25T20:35:20.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T20:35:20.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:35:20.151 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-25T20:35:20.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-25T20:35:20.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T20:35:20.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T20:35:20.312 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-25T20:35:20.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-25T20:35:20.393 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T20:35:20.406 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T20:35:20.406 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T20:35:20.407 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T20:35:20.409 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T20:35:20.409 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T20:35:20.412 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T20:35:20.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T20:35:20.437 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T20:35:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T20:35:20.450 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T20:35:20.455 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T20:35:20.462 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T20:35:20.471 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-04-25T20:35:20.475 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T20:35:20.480 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-04-25T20:35:20.481 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-04-25T20:35:20.491 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-04-25T20:35:20.494 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T20:35:20.498 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-25T20:35:20.506 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T20:35:20.507 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T20:35:20.509 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-25T20:35:20.520 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T20:35:20.522 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T20:35:20.534 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T20:35:20.565 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.569 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.577 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-25T20:35:20.579 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T20:35:20.579 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-25T20:35:20.580 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.580 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.580 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.580 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.592 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T20:35:20.595 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T20:35:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T20:35:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.596 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T20:35:20.597 INFO:teuthology.run_tasks:Running task install... 2024-04-25T20:35:20.605 DEBUG:teuthology.task.install:project ceph 2024-04-25T20:35:20.605 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T20:35:20.605 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T20:35:20.605 INFO:teuthology.task.install:Using flavor: default 2024-04-25T20:35:20.610 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T20:35:20.611 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T20:35:20.611 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T20:35:20.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:35:20.613 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T20:35:20.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:35:20.615 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T20:35:20.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:35:20.766 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T20:35:20.766 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T20:35:20.837 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T20:35:20.837 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T20:35:20.841 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T20:35:20.841 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T20:35:20.894 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T20:35:20.894 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:35:20.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T20:35:20.920 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T20:35:20.920 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T20:35:20.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T20:35:21.022 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T20:35:21.023 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:35:21.023 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T20:35:21.035 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T20:35:21.035 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:35:21.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T20:35:21.048 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T20:35:21.048 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T20:35:21.060 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T20:35:21.060 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T20:35:21.064 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T20:35:21.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T20:35:21.126 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T20:35:21.128 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-04-25T20:35:21.129 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-04-25T20:35:21.186 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T20:35:21.199 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T20:35:21.249 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-04-25T20:35:21.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-04-25T20:35:21.261 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-25T20:35:21.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-25T20:35:21.362 INFO:teuthology.orchestra.run.smithi043.stdout:48 files removed 2024-04-25T20:35:21.390 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T20:35:21.475 INFO:teuthology.orchestra.run.smithi112.stdout:48 files removed 2024-04-25T20:35:21.487 INFO:teuthology.orchestra.run.smithi195.stdout:48 files removed 2024-04-25T20:35:21.501 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T20:35:21.514 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T20:35:22.079 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 201 kB/s | 83 kB 00:00 2024-04-25T20:35:22.159 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 209 kB/s | 83 kB 00:00 2024-04-25T20:35:22.240 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-04-25T20:35:22.522 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-25T20:35:22.543 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-25T20:35:22.658 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-25T20:35:22.894 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-25T20:35:22.939 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-25T20:35:23.051 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-04-25T20:35:23.497 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T20:35:23.709 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T20:35:23.920 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-04-25T20:35:25.690 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-25T20:35:25.952 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-25T20:35:26.179 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T20:35:29.932 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.2 MB 00:00 2024-04-25T20:35:30.413 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-25T20:35:30.502 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.2 MB 00:00 2024-04-25T20:35:31.681 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-04-25T20:35:31.971 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-25T20:35:32.275 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 16 kB 00:00 2024-04-25T20:35:33.804 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T20:35:33.817 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-25T20:35:38.940 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T20:35:39.069 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-04-25T20:35:41.092 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.092 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.103 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T20:35:41.104 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.105 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T20:35:41.106 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T20:35:41.107 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T20:35:41.110 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T20:35:41.111 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T20:35:41.173 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-25T20:35:41.189 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T20:35:41.190 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T20:35:41.191 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T20:35:41.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-25T20:35:41.193 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T20:35:41.194 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T20:35:41.195 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T20:35:41.196 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T20:35:41.197 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T20:35:41.198 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T20:35:41.199 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T20:35:41.200 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T20:35:41.201 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 4 Packages 2024-04-25T20:35:41.202 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:35:41.203 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 222 M 2024-04-25T20:35:41.203 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-25T20:35:41.345 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.346 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.357 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T20:35:41.358 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T20:35:41.359 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T20:35:41.360 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T20:35:41.362 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T20:35:41.364 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T20:35:41.365 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T20:35:41.430 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-25T20:35:41.439 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T20:35:41.439 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-04-25T20:35:41.439 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T20:35:41.439 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-04-25T20:35:41.439 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T20:35:41.440 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T20:35:41.441 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:41.442 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T20:35:41.443 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T20:35:41.444 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T20:35:41.445 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T20:35:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T20:35:41.447 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T20:35:41.448 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T20:35:41.449 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-25T20:35:41.450 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-04-25T20:35:41.451 INFO:teuthology.orchestra.run.smithi043.stdout:Install 148 Packages 2024-04-25T20:35:41.451 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 4 Packages 2024-04-25T20:35:41.451 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:35:41.451 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 222 M 2024-04-25T20:35:41.451 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-25T20:35:41.754 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 21 MB 00:09 2024-04-25T20:35:42.000 INFO:teuthology.orchestra.run.smithi112.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 30 kB/s | 6.6 kB 00:00 2024-04-25T20:35:42.309 INFO:teuthology.orchestra.run.smithi112.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 2.8 MB/s | 890 kB 00:00 2024-04-25T20:35:42.384 INFO:teuthology.orchestra.run.smithi112.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 1.9 MB/s | 145 kB 00:00 2024-04-25T20:35:42.462 INFO:teuthology.orchestra.run.smithi043.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 38 kB/s | 6.6 kB 00:00 2024-04-25T20:35:42.712 INFO:teuthology.orchestra.run.smithi043.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 3.5 MB/s | 890 kB 00:00 2024-04-25T20:35:42.779 INFO:teuthology.orchestra.run.smithi043.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 2.1 MB/s | 145 kB 00:00 2024-04-25T20:35:42.859 INFO:teuthology.orchestra.run.smithi112.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 5.0 MB/s | 2.4 MB 00:00 2024-04-25T20:35:42.959 INFO:teuthology.orchestra.run.smithi112.stdout:(5/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 4.5 MB/s | 5.4 MB 00:01 2024-04-25T20:35:43.037 INFO:teuthology.orchestra.run.smithi043.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 9.1 MB/s | 2.4 MB 00:00 2024-04-25T20:35:43.185 INFO:teuthology.orchestra.run.smithi112.stdout:(6/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 4.6 MB/s | 1.5 MB 00:00 2024-04-25T20:35:43.321 INFO:teuthology.orchestra.run.smithi043.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 5.3 MB/s | 1.5 MB 00:00 2024-04-25T20:35:43.735 INFO:teuthology.orchestra.run.smithi112.stdout:(7/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 6.1 MB/s | 4.7 MB 00:00 2024-04-25T20:35:44.429 INFO:teuthology.orchestra.run.smithi043.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 4.2 MB/s | 4.7 MB 00:01 2024-04-25T20:35:44.710 INFO:teuthology.orchestra.run.smithi112.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 7.2 MB/s | 21 MB 00:02 2024-04-25T20:35:44.713 INFO:teuthology.orchestra.run.smithi043.stdout:(7/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 2.2 MB/s | 5.4 MB 00:02 2024-04-25T20:35:44.777 INFO:teuthology.orchestra.run.smithi112.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 378 kB/s | 25 kB 00:00 2024-04-25T20:35:45.485 INFO:teuthology.orchestra.run.smithi112.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 6.1 MB/s | 11 MB 00:01 2024-04-25T20:35:45.594 INFO:teuthology.orchestra.run.smithi112.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 2.0 MB/s | 225 kB 00:00 2024-04-25T20:35:45.694 INFO:teuthology.orchestra.run.smithi112.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 270 kB/s | 27 kB 00:00 2024-04-25T20:35:45.794 INFO:teuthology.orchestra.run.smithi112.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 317 kB/s | 32 kB 00:00 2024-04-25T20:35:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:(14/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 5.8 MB/s | 17 MB 00:02 2024-04-25T20:35:46.121 INFO:teuthology.orchestra.run.smithi112.stdout:(15/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 2.2 MB/s | 747 kB 00:00 2024-04-25T20:35:46.163 INFO:teuthology.orchestra.run.smithi112.stdout:(16/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 2.1 MB/s | 163 kB 00:00 2024-04-25T20:35:46.196 INFO:teuthology.orchestra.run.smithi112.stdout:(17/152): librados-devel-19.0.0-3156.gd69f13d8. 1.6 MB/s | 126 kB 00:00 2024-04-25T20:35:46.280 INFO:teuthology.orchestra.run.smithi112.stdout:(18/152): libradosstriper1-19.0.0-3156.gd69f13d 4.2 MB/s | 500 kB 00:00 2024-04-25T20:35:46.397 INFO:teuthology.orchestra.run.smithi112.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 387 kB/s | 45 kB 00:00 2024-04-25T20:35:46.489 INFO:teuthology.orchestra.run.smithi112.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 1.4 MB/s | 135 kB 00:00 2024-04-25T20:35:46.572 INFO:teuthology.orchestra.run.smithi112.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 1.9 MB/s | 161 kB 00:00 2024-04-25T20:35:46.681 INFO:teuthology.orchestra.run.smithi112.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 2.9 MB/s | 320 kB 00:00 2024-04-25T20:35:46.773 INFO:teuthology.orchestra.run.smithi112.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 3.2 MB/s | 298 kB 00:00 2024-04-25T20:35:46.804 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T20:35:46.865 INFO:teuthology.orchestra.run.smithi112.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 1.1 MB/s | 99 kB 00:00 2024-04-25T20:35:46.957 INFO:teuthology.orchestra.run.smithi112.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 928 kB/s | 85 kB 00:00 2024-04-25T20:35:47.524 INFO:teuthology.orchestra.run.smithi112.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 5.5 MB/s | 3.1 MB 00:00 2024-04-25T20:35:47.624 INFO:teuthology.orchestra.run.smithi112.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 1.7 MB/s | 170 kB 00:00 2024-04-25T20:35:47.737 INFO:teuthology.orchestra.run.smithi112.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 303 kB/s | 34 kB 00:00 2024-04-25T20:35:47.850 INFO:teuthology.orchestra.run.smithi112.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.2 MB/s | 142 kB 00:00 2024-04-25T20:35:48.026 INFO:teuthology.orchestra.run.smithi112.stdout:(30/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 2.9 MB/s | 5.4 MB 00:01 2024-04-25T20:35:48.205 INFO:teuthology.orchestra.run.smithi043.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 4.5 MB/s | 17 MB 00:03 2024-04-25T20:35:48.271 INFO:teuthology.orchestra.run.smithi043.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 382 kB/s | 25 kB 00:00 2024-04-25T20:35:48.643 INFO:teuthology.orchestra.run.smithi112.stdout:(31/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 13 MB/s | 49 MB 00:03 2024-04-25T20:35:48.710 INFO:teuthology.orchestra.run.smithi112.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 4.1 MB/s | 3.5 MB 00:00 2024-04-25T20:35:48.743 INFO:teuthology.orchestra.run.smithi112.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3156.gd6 2.4 MB/s | 249 kB 00:00 2024-04-25T20:35:48.776 INFO:teuthology.orchestra.run.smithi112.stdout:(34/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 739 kB/s | 49 kB 00:00 2024-04-25T20:35:48.794 INFO:teuthology.orchestra.run.smithi112.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3156.gd 329 kB/s | 16 kB 00:00 2024-04-25T20:35:48.852 INFO:teuthology.orchestra.run.smithi112.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 3.5 MB/s | 273 kB 00:00 2024-04-25T20:35:48.936 INFO:teuthology.orchestra.run.smithi112.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 5.2 MB/s | 762 kB 00:00 2024-04-25T20:35:48.953 INFO:teuthology.orchestra.run.smithi112.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 182 kB/s | 18 kB 00:00 2024-04-25T20:35:48.954 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:48.955 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T20:35:48.966 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T20:35:48.967 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T20:35:48.968 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T20:35:48.969 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T20:35:48.970 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T20:35:48.973 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T20:35:48.973 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T20:35:49.035 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T20:35:49.055 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T20:35:49.056 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T20:35:49.057 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T20:35:49.058 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T20:35:49.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T20:35:49.060 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T20:35:49.061 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T20:35:49.062 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T20:35:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T20:35:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T20:35:49.065 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T20:35:49.066 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout:Install 148 Packages 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 4 Packages 2024-04-25T20:35:49.067 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:35:49.068 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 222 M 2024-04-25T20:35:49.068 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-25T20:35:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 601 kB/s | 80 kB 00:00 2024-04-25T20:35:49.128 INFO:teuthology.orchestra.run.smithi112.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-04-25T20:35:49.154 INFO:teuthology.orchestra.run.smithi112.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-25T20:35:49.171 INFO:teuthology.orchestra.run.smithi043.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 2.4 MB/s | 11 MB 00:04 2024-04-25T20:35:49.187 INFO:teuthology.orchestra.run.smithi112.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-04-25T20:35:49.305 INFO:teuthology.orchestra.run.smithi043.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 1.6 MB/s | 225 kB 00:00 2024-04-25T20:35:49.329 INFO:teuthology.orchestra.run.smithi112.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-04-25T20:35:49.354 INFO:teuthology.orchestra.run.smithi112.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2024-04-25T20:35:49.372 INFO:teuthology.orchestra.run.smithi043.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 406 kB/s | 27 kB 00:00 2024-04-25T20:35:49.380 INFO:teuthology.orchestra.run.smithi112.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T20:35:49.439 INFO:teuthology.orchestra.run.smithi043.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 475 kB/s | 32 kB 00:00 2024-04-25T20:35:49.463 INFO:teuthology.orchestra.run.smithi112.stdout:(46/152): ceph-mgr-diskprediction-local-19.0.0- 5.1 MB/s | 7.4 MB 00:01 2024-04-25T20:35:49.489 INFO:teuthology.orchestra.run.smithi112.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 934 kB/s | 125 kB 00:00 2024-04-25T20:35:49.514 INFO:teuthology.orchestra.run.smithi112.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-04-25T20:35:49.556 INFO:teuthology.orchestra.run.smithi112.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 7.4 MB/s | 689 kB 00:00 2024-04-25T20:35:49.589 INFO:teuthology.orchestra.run.smithi112.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-25T20:35:49.631 INFO:teuthology.orchestra.run.smithi112.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-04-25T20:35:49.648 INFO:teuthology.orchestra.run.smithi112.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 234 kB/s | 21 kB 00:00 2024-04-25T20:35:49.656 INFO:teuthology.orchestra.run.smithi043.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 3.4 MB/s | 747 kB 00:00 2024-04-25T20:35:49.682 INFO:teuthology.orchestra.run.smithi112.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 3.4 MB/s | 313 kB 00:00 2024-04-25T20:35:49.699 INFO:teuthology.orchestra.run.smithi112.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 661 kB/s | 33 kB 00:00 2024-04-25T20:35:49.723 INFO:teuthology.orchestra.run.smithi043.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 2.4 MB/s | 163 kB 00:00 2024-04-25T20:35:49.758 INFO:teuthology.orchestra.run.smithi112.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-25T20:35:49.790 INFO:teuthology.orchestra.run.smithi043.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.9 MB/s | 126 kB 00:00 2024-04-25T20:35:49.833 INFO:teuthology.orchestra.run.smithi112.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-25T20:35:49.850 INFO:teuthology.orchestra.run.smithi112.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 74 kB/s | 11 kB 00:00 2024-04-25T20:35:49.875 INFO:teuthology.orchestra.run.smithi112.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-25T20:35:49.900 INFO:teuthology.orchestra.run.smithi112.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T20:35:49.926 INFO:teuthology.orchestra.run.smithi112.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-25T20:35:49.932 INFO:teuthology.orchestra.run.smithi043.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 3.5 MB/s | 500 kB 00:00 2024-04-25T20:35:49.959 INFO:teuthology.orchestra.run.smithi112.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-25T20:35:49.985 INFO:teuthology.orchestra.run.smithi112.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 307 kB/s | 25 kB 00:00 2024-04-25T20:35:50.005 INFO:teuthology.orchestra.run.smithi195.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-25T20:35:50.010 INFO:teuthology.orchestra.run.smithi112.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 570 kB/s | 47 kB 00:00 2024-04-25T20:35:50.035 INFO:teuthology.orchestra.run.smithi112.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T20:35:50.060 INFO:teuthology.orchestra.run.smithi112.stdout:(65/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-25T20:35:50.085 INFO:teuthology.orchestra.run.smithi112.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 470 kB/s | 35 kB 00:00 2024-04-25T20:35:50.244 INFO:teuthology.orchestra.run.smithi112.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T20:35:50.320 INFO:teuthology.orchestra.run.smithi112.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-04-25T20:35:50.386 INFO:teuthology.orchestra.run.smithi112.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-25T20:35:50.411 INFO:teuthology.orchestra.run.smithi112.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 5.4 MB/s | 911 kB 00:00 2024-04-25T20:35:50.436 INFO:teuthology.orchestra.run.smithi112.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-25T20:35:50.479 INFO:teuthology.orchestra.run.smithi112.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.0 MB/s | 87 kB 00:00 2024-04-25T20:35:50.520 INFO:teuthology.orchestra.run.smithi112.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-25T20:35:50.638 INFO:teuthology.orchestra.run.smithi112.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-04-25T20:35:50.663 INFO:teuthology.orchestra.run.smithi112.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-25T20:35:50.688 INFO:teuthology.orchestra.run.smithi195.stdout:(2/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 5.8 MB/s | 5.4 MB 00:00 2024-04-25T20:35:50.747 INFO:teuthology.orchestra.run.smithi112.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-25T20:35:50.763 INFO:teuthology.orchestra.run.smithi195.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 1.9 MB/s | 145 kB 00:00 2024-04-25T20:35:50.772 INFO:teuthology.orchestra.run.smithi112.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-04-25T20:35:50.797 INFO:teuthology.orchestra.run.smithi112.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 195 kB/s | 26 kB 00:00 2024-04-25T20:35:50.797 INFO:teuthology.orchestra.run.smithi195.stdout:(4/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T20:35:50.822 INFO:teuthology.orchestra.run.smithi112.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-25T20:35:50.847 INFO:teuthology.orchestra.run.smithi112.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-25T20:35:50.873 INFO:teuthology.orchestra.run.smithi112.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-04-25T20:35:50.906 INFO:teuthology.orchestra.run.smithi112.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-25T20:35:50.931 INFO:teuthology.orchestra.run.smithi112.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T20:35:50.957 INFO:teuthology.orchestra.run.smithi112.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 77 kB 00:00 2024-04-25T20:35:51.024 INFO:teuthology.orchestra.run.smithi112.stdout:(85/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-25T20:35:51.049 INFO:teuthology.orchestra.run.smithi112.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 369 kB/s | 42 kB 00:00 2024-04-25T20:35:51.074 INFO:teuthology.orchestra.run.smithi112.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-04-25T20:35:51.100 INFO:teuthology.orchestra.run.smithi112.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T20:35:51.106 INFO:teuthology.orchestra.run.smithi195.stdout:(5/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 6.9 MB/s | 2.4 MB 00:00 2024-04-25T20:35:51.127 INFO:teuthology.orchestra.run.smithi112.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 279 kB 00:00 2024-04-25T20:35:51.152 INFO:teuthology.orchestra.run.smithi112.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 662 kB/s | 51 kB 00:00 2024-04-25T20:35:51.177 INFO:teuthology.orchestra.run.smithi112.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-25T20:35:51.202 INFO:teuthology.orchestra.run.smithi112.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-04-25T20:35:51.228 INFO:teuthology.orchestra.run.smithi112.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 889 kB/s | 44 kB 00:00 2024-04-25T20:35:51.261 INFO:teuthology.orchestra.run.smithi112.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.9 MB/s | 221 kB 00:00 2024-04-25T20:35:51.287 INFO:teuthology.orchestra.run.smithi112.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 640 kB/s | 36 kB 00:00 2024-04-25T20:35:51.312 INFO:teuthology.orchestra.run.smithi112.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 994 kB/s | 47 kB 00:00 2024-04-25T20:35:51.346 INFO:teuthology.orchestra.run.smithi112.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.3 MB/s | 305 kB 00:00 2024-04-25T20:35:51.371 INFO:teuthology.orchestra.run.smithi112.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-25T20:35:51.396 INFO:teuthology.orchestra.run.smithi112.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-25T20:35:51.555 INFO:teuthology.orchestra.run.smithi112.stdout:(100/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-04-25T20:35:51.580 INFO:teuthology.orchestra.run.smithi112.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 308 kB/s | 64 kB 00:00 2024-04-25T20:35:51.605 INFO:teuthology.orchestra.run.smithi112.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 215 kB/s | 45 kB 00:00 2024-04-25T20:35:51.631 INFO:teuthology.orchestra.run.smithi112.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 449 kB/s | 22 kB 00:00 2024-04-25T20:35:51.664 INFO:teuthology.orchestra.run.smithi112.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-04-25T20:35:51.723 INFO:teuthology.orchestra.run.smithi195.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 7.6 MB/s | 4.7 MB 00:00 2024-04-25T20:35:51.814 INFO:teuthology.orchestra.run.smithi112.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 130 kB/s | 19 kB 00:00 2024-04-25T20:35:51.898 INFO:teuthology.orchestra.run.smithi195.stdout:(7/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 1.4 MB/s | 1.5 MB 00:01 2024-04-25T20:35:51.940 INFO:teuthology.orchestra.run.smithi112.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-04-25T20:35:51.965 INFO:teuthology.orchestra.run.smithi112.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-04-25T20:35:51.999 INFO:teuthology.orchestra.run.smithi112.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 442 kB/s | 26 kB 00:00 2024-04-25T20:35:52.032 INFO:teuthology.orchestra.run.smithi112.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-04-25T20:35:52.074 INFO:teuthology.orchestra.run.smithi112.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-04-25T20:35:52.081 INFO:teuthology.orchestra.run.smithi043.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 2.5 MB/s | 5.4 MB 00:02 2024-04-25T20:35:52.108 INFO:teuthology.orchestra.run.smithi112.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-25T20:35:52.140 INFO:teuthology.orchestra.run.smithi195.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 8.9 MB/s | 21 MB 00:02 2024-04-25T20:35:52.165 INFO:teuthology.orchestra.run.smithi043.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 543 kB/s | 45 kB 00:00 2024-04-25T20:35:52.198 INFO:teuthology.orchestra.run.smithi195.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 434 kB/s | 25 kB 00:00 2024-04-25T20:35:52.240 INFO:teuthology.orchestra.run.smithi043.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 1.8 MB/s | 135 kB 00:00 2024-04-25T20:35:52.258 INFO:teuthology.orchestra.run.smithi112.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-25T20:35:52.284 INFO:teuthology.orchestra.run.smithi112.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-04-25T20:35:52.317 INFO:teuthology.orchestra.run.smithi112.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-04-25T20:35:52.334 INFO:teuthology.orchestra.run.smithi112.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 576 kB/s | 43 kB 00:00 2024-04-25T20:35:52.351 INFO:teuthology.orchestra.run.smithi112.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 480 kB/s | 32 kB 00:00 2024-04-25T20:35:52.368 INFO:teuthology.orchestra.run.smithi112.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-25T20:35:52.408 INFO:teuthology.orchestra.run.smithi043.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 968 kB/s | 161 kB 00:00 2024-04-25T20:35:52.419 INFO:teuthology.orchestra.run.smithi112.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T20:35:52.444 INFO:teuthology.orchestra.run.smithi112.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-25T20:35:52.469 INFO:teuthology.orchestra.run.smithi112.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-04-25T20:35:52.494 INFO:teuthology.orchestra.run.smithi112.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-25T20:35:52.519 INFO:teuthology.orchestra.run.smithi112.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T20:35:52.578 INFO:teuthology.orchestra.run.smithi112.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-04-25T20:35:52.603 INFO:teuthology.orchestra.run.smithi112.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-25T20:35:52.629 INFO:teuthology.orchestra.run.smithi112.stdout:(125/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T20:35:52.654 INFO:teuthology.orchestra.run.smithi112.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-25T20:35:52.658 INFO:teuthology.orchestra.run.smithi043.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.3 MB/s | 320 kB 00:00 2024-04-25T20:35:52.679 INFO:teuthology.orchestra.run.smithi112.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-04-25T20:35:52.705 INFO:teuthology.orchestra.run.smithi112.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-25T20:35:52.730 INFO:teuthology.orchestra.run.smithi112.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-04-25T20:35:52.763 INFO:teuthology.orchestra.run.smithi112.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-25T20:35:52.789 INFO:teuthology.orchestra.run.smithi112.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 553 kB/s | 46 kB 00:00 2024-04-25T20:35:52.814 INFO:teuthology.orchestra.run.smithi112.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 941 kB/s | 79 kB 00:00 2024-04-25T20:35:52.839 INFO:teuthology.orchestra.run.smithi112.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2024-04-25T20:35:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.5 MB/s | 298 kB 00:00 2024-04-25T20:35:52.864 INFO:teuthology.orchestra.run.smithi112.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T20:35:52.881 INFO:teuthology.orchestra.run.smithi112.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-04-25T20:35:52.907 INFO:teuthology.orchestra.run.smithi112.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T20:35:52.923 INFO:teuthology.orchestra.run.smithi112.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 480 kB/s | 28 kB 00:00 2024-04-25T20:35:52.940 INFO:teuthology.orchestra.run.smithi112.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-04-25T20:35:52.959 INFO:teuthology.orchestra.run.smithi043.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 913 kB/s | 99 kB 00:00 2024-04-25T20:35:52.966 INFO:teuthology.orchestra.run.smithi112.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-25T20:35:52.991 INFO:teuthology.orchestra.run.smithi112.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 880 kB/s | 59 kB 00:00 2024-04-25T20:35:53.016 INFO:teuthology.orchestra.run.smithi112.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-04-25T20:35:53.042 INFO:teuthology.orchestra.run.smithi112.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-04-25T20:35:53.067 INFO:teuthology.orchestra.run.smithi112.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T20:35:53.068 INFO:teuthology.orchestra.run.smithi043.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 787 kB/s | 85 kB 00:00 2024-04-25T20:35:53.092 INFO:teuthology.orchestra.run.smithi112.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T20:35:53.118 INFO:teuthology.orchestra.run.smithi112.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-25T20:35:53.143 INFO:teuthology.orchestra.run.smithi112.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-25T20:35:53.176 INFO:teuthology.orchestra.run.smithi112.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T20:35:53.219 INFO:teuthology.orchestra.run.smithi112.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T20:35:53.285 INFO:teuthology.orchestra.run.smithi112.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T20:35:53.394 INFO:teuthology.orchestra.run.smithi112.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-04-25T20:35:53.657 INFO:teuthology.orchestra.run.smithi195.stdout:(10/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 8.7 MB/s | 17 MB 00:01 2024-04-25T20:35:53.757 INFO:teuthology.orchestra.run.smithi195.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 2.2 MB/s | 225 kB 00:00 2024-04-25T20:35:53.857 INFO:teuthology.orchestra.run.smithi195.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 270 kB/s | 27 kB 00:00 2024-04-25T20:35:53.949 INFO:teuthology.orchestra.run.smithi195.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 347 kB/s | 32 kB 00:00 2024-04-25T20:35:54.244 INFO:teuthology.orchestra.run.smithi112.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 3.1 MB/s | 3.4 MB 00:01 2024-04-25T20:35:54.295 INFO:teuthology.orchestra.run.smithi112.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 2.8 MB/s | 3.1 MB 00:01 2024-04-25T20:35:54.300 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-25T20:35:54.300 INFO:teuthology.orchestra.run.smithi112.stdout:Total 17 MB/s | 222 MB 00:13 2024-04-25T20:35:54.333 INFO:teuthology.orchestra.run.smithi195.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 1.9 MB/s | 747 kB 00:00 2024-04-25T20:35:54.458 INFO:teuthology.orchestra.run.smithi195.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 1.3 MB/s | 163 kB 00:00 2024-04-25T20:35:54.550 INFO:teuthology.orchestra.run.smithi195.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.3 MB/s | 126 kB 00:00 2024-04-25T20:35:54.626 INFO:teuthology.orchestra.run.smithi043.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 2.0 MB/s | 3.1 MB 00:01 2024-04-25T20:35:54.758 INFO:teuthology.orchestra.run.smithi195.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 2.3 MB/s | 500 kB 00:00 2024-04-25T20:35:54.768 INFO:teuthology.orchestra.run.smithi043.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 1.2 MB/s | 170 kB 00:00 2024-04-25T20:35:54.835 INFO:teuthology.orchestra.run.smithi043.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 515 kB/s | 34 kB 00:00 2024-04-25T20:35:54.960 INFO:teuthology.orchestra.run.smithi043.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.1 MB/s | 142 kB 00:00 2024-04-25T20:35:55.403 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-25T20:35:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-25T20:35:55.544 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-25T20:35:56.142 INFO:teuthology.orchestra.run.smithi195.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 3.9 MB/s | 5.4 MB 00:01 2024-04-25T20:35:56.201 INFO:teuthology.orchestra.run.smithi195.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 777 kB/s | 45 kB 00:00 2024-04-25T20:35:56.202 INFO:teuthology.orchestra.run.smithi043.stdout:(30/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 6.2 MB/s | 49 MB 00:07 2024-04-25T20:35:56.359 INFO:teuthology.orchestra.run.smithi195.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 853 kB/s | 135 kB 00:00 2024-04-25T20:35:56.494 INFO:teuthology.orchestra.run.smithi043.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 2.3 MB/s | 3.5 MB 00:01 2024-04-25T20:35:56.594 INFO:teuthology.orchestra.run.smithi043.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 2.4 MB/s | 249 kB 00:00 2024-04-25T20:35:56.653 INFO:teuthology.orchestra.run.smithi043.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 844 kB/s | 49 kB 00:00 2024-04-25T20:35:56.712 INFO:teuthology.orchestra.run.smithi043.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 283 kB/s | 16 kB 00:00 2024-04-25T20:35:56.802 INFO:teuthology.orchestra.run.smithi195.stdout:(21/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 11 MB/s | 49 MB 00:04 2024-04-25T20:35:56.812 INFO:teuthology.orchestra.run.smithi043.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 2.7 MB/s | 273 kB 00:00 2024-04-25T20:35:56.827 INFO:teuthology.orchestra.run.smithi195.stdout:(22/152): python3-cephfs-19.0.0-3156.gd69f13d8. 345 kB/s | 161 kB 00:00 2024-04-25T20:35:56.969 INFO:teuthology.orchestra.run.smithi195.stdout:(23/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 2.1 MB/s | 11 MB 00:05 2024-04-25T20:35:56.994 INFO:teuthology.orchestra.run.smithi195.stdout:(24/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.6 MB/s | 320 kB 00:00 2024-04-25T20:35:57.019 INFO:teuthology.orchestra.run.smithi195.stdout:(25/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.5 MB/s | 298 kB 00:00 2024-04-25T20:35:57.044 INFO:teuthology.orchestra.run.smithi195.stdout:(26/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.7 MB/s | 85 kB 00:00 2024-04-25T20:35:57.112 INFO:teuthology.orchestra.run.smithi043.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 8.1 MB/s | 7.4 MB 00:00 2024-04-25T20:35:57.138 INFO:teuthology.orchestra.run.smithi043.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 2.3 MB/s | 762 kB 00:00 2024-04-25T20:35:57.153 INFO:teuthology.orchestra.run.smithi195.stdout:(27/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 541 kB/s | 99 kB 00:00 2024-04-25T20:35:57.163 INFO:teuthology.orchestra.run.smithi043.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 365 kB/s | 18 kB 00:00 2024-04-25T20:35:57.204 INFO:teuthology.orchestra.run.smithi195.stdout:(28/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 1.0 MB/s | 170 kB 00:00 2024-04-25T20:35:57.221 INFO:teuthology.orchestra.run.smithi195.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 508 kB/s | 34 kB 00:00 2024-04-25T20:35:57.271 INFO:teuthology.orchestra.run.smithi195.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 2.1 MB/s | 142 kB 00:00 2024-04-25T20:35:57.296 INFO:teuthology.orchestra.run.smithi043.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-25T20:35:57.329 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-25T20:35:57.330 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-25T20:35:57.346 INFO:teuthology.orchestra.run.smithi043.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-04-25T20:35:57.372 INFO:teuthology.orchestra.run.smithi043.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-25T20:35:57.397 INFO:teuthology.orchestra.run.smithi043.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-25T20:35:57.496 INFO:teuthology.orchestra.run.smithi195.stdout:(31/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 6.5 MB/s | 3.1 MB 00:00 2024-04-25T20:35:57.555 INFO:teuthology.orchestra.run.smithi195.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 11 MB/s | 3.5 MB 00:00 2024-04-25T20:35:57.606 INFO:teuthology.orchestra.run.smithi043.stdout:(43/152): ceph-common-19.0.0-3156.gd69f13d8.el7 1.4 MB/s | 21 MB 00:15 2024-04-25T20:35:57.623 INFO:teuthology.orchestra.run.smithi195.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3156.gd6 1.9 MB/s | 249 kB 00:00 2024-04-25T20:35:57.639 INFO:teuthology.orchestra.run.smithi043.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-04-25T20:35:57.647 INFO:teuthology.orchestra.run.smithi195.stdout:(34/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 538 kB/s | 49 kB 00:00 2024-04-25T20:35:57.664 INFO:teuthology.orchestra.run.smithi043.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 400 kB/s | 106 kB 00:00 2024-04-25T20:35:57.672 INFO:teuthology.orchestra.run.smithi195.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3156.gd 338 kB/s | 16 kB 00:00 2024-04-25T20:35:57.690 INFO:teuthology.orchestra.run.smithi043.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-25T20:35:57.697 INFO:teuthology.orchestra.run.smithi195.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 5.3 MB/s | 273 kB 00:00 2024-04-25T20:35:57.715 INFO:teuthology.orchestra.run.smithi043.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T20:35:57.739 INFO:teuthology.orchestra.run.smithi195.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 439 kB/s | 18 kB 00:00 2024-04-25T20:35:57.740 INFO:teuthology.orchestra.run.smithi043.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-25T20:35:57.766 INFO:teuthology.orchestra.run.smithi043.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-04-25T20:35:57.773 INFO:teuthology.orchestra.run.smithi195.stdout:(38/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 7.4 MB/s | 762 kB 00:00 2024-04-25T20:35:57.791 INFO:teuthology.orchestra.run.smithi043.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-25T20:35:57.835 INFO:teuthology.orchestra.run.smithi043.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 9.9 MB/s | 943 kB 00:00 2024-04-25T20:35:57.860 INFO:teuthology.orchestra.run.smithi043.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 229 kB/s | 21 kB 00:00 2024-04-25T20:35:57.885 INFO:teuthology.orchestra.run.smithi043.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-04-25T20:35:57.911 INFO:teuthology.orchestra.run.smithi043.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 662 kB/s | 33 kB 00:00 2024-04-25T20:35:57.915 INFO:teuthology.orchestra.run.smithi195.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 458 kB/s | 80 kB 00:00 2024-04-25T20:35:57.982 INFO:teuthology.orchestra.run.smithi195.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-04-25T20:35:57.986 INFO:teuthology.orchestra.run.smithi043.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-25T20:35:58.011 INFO:teuthology.orchestra.run.smithi043.stdout:(56/152): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 18 kB 00:00 2024-04-25T20:35:58.015 INFO:teuthology.orchestra.run.smithi195.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-04-25T20:35:58.036 INFO:teuthology.orchestra.run.smithi043.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 90 kB/s | 11 kB 00:00 2024-04-25T20:35:58.042 INFO:teuthology.orchestra.run.smithi195.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-25T20:35:58.061 INFO:teuthology.orchestra.run.smithi043.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-25T20:35:58.087 INFO:teuthology.orchestra.run.smithi043.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T20:35:58.091 INFO:teuthology.orchestra.run.smithi195.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-04-25T20:35:58.112 INFO:teuthology.orchestra.run.smithi043.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-04-25T20:35:58.116 INFO:teuthology.orchestra.run.smithi195.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-25T20:35:58.137 INFO:teuthology.orchestra.run.smithi043.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 582 kB 00:00 2024-04-25T20:35:58.141 INFO:teuthology.orchestra.run.smithi195.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T20:35:58.162 INFO:teuthology.orchestra.run.smithi043.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 971 kB/s | 47 kB 00:00 2024-04-25T20:35:58.167 INFO:teuthology.orchestra.run.smithi195.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T20:35:58.188 INFO:teuthology.orchestra.run.smithi043.stdout:(63/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 342 kB/s | 25 kB 00:00 2024-04-25T20:35:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T20:35:58.213 INFO:teuthology.orchestra.run.smithi043.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-25T20:35:58.217 INFO:teuthology.orchestra.run.smithi195.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T20:35:58.238 INFO:teuthology.orchestra.run.smithi043.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-04-25T20:35:58.259 INFO:teuthology.orchestra.run.smithi195.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T20:35:58.272 INFO:teuthology.orchestra.run.smithi043.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 35 kB 00:00 2024-04-25T20:35:58.276 INFO:teuthology.orchestra.run.smithi195.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T20:35:58.302 INFO:teuthology.orchestra.run.smithi195.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-04-25T20:35:58.335 INFO:teuthology.orchestra.run.smithi195.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T20:35:58.356 INFO:teuthology.orchestra.run.smithi043.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-04-25T20:35:58.360 INFO:teuthology.orchestra.run.smithi195.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-04-25T20:35:58.397 INFO:teuthology.orchestra.run.smithi043.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T20:35:58.402 INFO:teuthology.orchestra.run.smithi195.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 449 kB/s | 18 kB 00:00 2024-04-25T20:35:58.461 INFO:teuthology.orchestra.run.smithi195.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-25T20:35:58.464 INFO:teuthology.orchestra.run.smithi043.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-25T20:35:58.486 INFO:teuthology.orchestra.run.smithi195.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 137 kB/s | 11 kB 00:00 2024-04-25T20:35:58.498 INFO:teuthology.orchestra.run.smithi043.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 6.4 MB/s | 911 kB 00:00 2024-04-25T20:35:58.512 INFO:teuthology.orchestra.run.smithi195.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T20:35:58.523 INFO:teuthology.orchestra.run.smithi043.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-04-25T20:35:58.537 INFO:teuthology.orchestra.run.smithi195.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-04-25T20:35:58.562 INFO:teuthology.orchestra.run.smithi195.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T20:35:58.565 INFO:teuthology.orchestra.run.smithi043.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.2 MB/s | 87 kB 00:00 2024-04-25T20:35:58.596 INFO:teuthology.orchestra.run.smithi195.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-25T20:35:58.621 INFO:teuthology.orchestra.run.smithi195.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 442 kB/s | 25 kB 00:00 2024-04-25T20:35:58.638 INFO:teuthology.orchestra.run.smithi195.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-25T20:35:58.664 INFO:teuthology.orchestra.run.smithi195.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T20:35:58.665 INFO:teuthology.orchestra.run.smithi043.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 29 MB/s | 5.8 MB 00:00 2024-04-25T20:35:58.689 INFO:teuthology.orchestra.run.smithi195.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T20:35:58.699 INFO:teuthology.orchestra.run.smithi043.stdout:(74/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.9 MB/s | 1.0 MB 00:00 2024-04-25T20:35:58.706 INFO:teuthology.orchestra.run.smithi195.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 849 kB/s | 35 kB 00:00 2024-04-25T20:35:58.799 INFO:teuthology.orchestra.run.smithi043.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-04-25T20:35:58.824 INFO:teuthology.orchestra.run.smithi043.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-04-25T20:35:58.850 INFO:teuthology.orchestra.run.smithi043.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-25T20:35:58.866 INFO:teuthology.orchestra.run.smithi043.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 388 kB/s | 26 kB 00:00 2024-04-25T20:35:58.873 INFO:teuthology.orchestra.run.smithi195.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-25T20:35:58.892 INFO:teuthology.orchestra.run.smithi043.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-04-25T20:35:58.917 INFO:teuthology.orchestra.run.smithi043.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T20:35:58.931 INFO:teuthology.orchestra.run.smithi195.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-25T20:35:58.959 INFO:teuthology.orchestra.run.smithi043.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 377 kB/s | 35 kB 00:00 2024-04-25T20:35:58.965 INFO:teuthology.orchestra.run.smithi195.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2024-04-25T20:35:59.001 INFO:teuthology.orchestra.run.smithi043.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-25T20:35:59.007 INFO:teuthology.orchestra.run.smithi195.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-25T20:35:59.032 INFO:teuthology.orchestra.run.smithi195.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T20:35:59.076 INFO:teuthology.orchestra.run.smithi043.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-04-25T20:35:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-25T20:35:59.101 INFO:teuthology.orchestra.run.smithi043.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-04-25T20:35:59.127 INFO:teuthology.orchestra.run.smithi043.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 629 kB/s | 77 kB 00:00 2024-04-25T20:35:59.152 INFO:teuthology.orchestra.run.smithi043.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-04-25T20:35:59.177 INFO:teuthology.orchestra.run.smithi043.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-25T20:35:59.191 INFO:teuthology.orchestra.run.smithi195.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-04-25T20:35:59.202 INFO:teuthology.orchestra.run.smithi043.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-25T20:35:59.216 INFO:teuthology.orchestra.run.smithi195.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 763 kB/s | 87 kB 00:00 2024-04-25T20:35:59.228 INFO:teuthology.orchestra.run.smithi043.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T20:35:59.253 INFO:teuthology.orchestra.run.smithi043.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 682 kB/s | 51 kB 00:00 2024-04-25T20:35:59.258 INFO:teuthology.orchestra.run.smithi195.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.9 MB/s | 244 kB 00:00 2024-04-25T20:35:59.278 INFO:teuthology.orchestra.run.smithi043.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 718 kB/s | 54 kB 00:00 2024-04-25T20:35:59.317 INFO:teuthology.orchestra.run.smithi195.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.3 MB/s | 248 kB 00:00 2024-04-25T20:35:59.362 INFO:teuthology.orchestra.run.smithi043.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-04-25T20:35:59.393 INFO:teuthology.orchestra.run.smithi195.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-04-25T20:35:59.418 INFO:teuthology.orchestra.run.smithi195.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 257 kB/s | 26 kB 00:00 2024-04-25T20:35:59.443 INFO:teuthology.orchestra.run.smithi195.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-25T20:35:59.471 INFO:teuthology.orchestra.run.smithi195.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T20:35:59.487 INFO:teuthology.orchestra.run.smithi043.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 213 kB/s | 44 kB 00:00 2024-04-25T20:35:59.493 INFO:teuthology.orchestra.run.smithi195.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-25T20:35:59.535 INFO:teuthology.orchestra.run.smithi195.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.1 MB/s | 250 kB 00:00 2024-04-25T20:35:59.577 INFO:teuthology.orchestra.run.smithi195.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 5.5 MB/s | 222 kB 00:00 2024-04-25T20:35:59.644 INFO:teuthology.orchestra.run.smithi195.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-25T20:35:59.646 INFO:teuthology.orchestra.run.smithi043.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-04-25T20:35:59.669 INFO:teuthology.orchestra.run.smithi195.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 843 kB/s | 77 kB 00:00 2024-04-25T20:35:59.671 INFO:teuthology.orchestra.run.smithi043.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 722 kB/s | 221 kB 00:00 2024-04-25T20:35:59.695 INFO:teuthology.orchestra.run.smithi195.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-04-25T20:35:59.696 INFO:teuthology.orchestra.run.smithi043.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 172 kB/s | 36 kB 00:00 2024-04-25T20:35:59.721 INFO:teuthology.orchestra.run.smithi043.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T20:35:59.722 INFO:teuthology.orchestra.run.smithi195.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.0 MB/s | 269 kB 00:00 2024-04-25T20:35:59.747 INFO:teuthology.orchestra.run.smithi043.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-25T20:35:59.747 INFO:teuthology.orchestra.run.smithi195.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.0 MB/s | 159 kB 00:00 2024-04-25T20:35:59.772 INFO:teuthology.orchestra.run.smithi043.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-04-25T20:35:59.772 INFO:teuthology.orchestra.run.smithi195.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T20:35:59.797 INFO:teuthology.orchestra.run.smithi043.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T20:35:59.798 INFO:teuthology.orchestra.run.smithi195.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T20:35:59.815 INFO:teuthology.orchestra.run.smithi195.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-04-25T20:35:59.822 INFO:teuthology.orchestra.run.smithi043.stdout:(101/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-04-25T20:35:59.847 INFO:teuthology.orchestra.run.smithi043.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-04-25T20:35:59.873 INFO:teuthology.orchestra.run.smithi043.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-04-25T20:35:59.899 INFO:teuthology.orchestra.run.smithi195.stdout:(91/152): ceph-mgr-diskprediction-local-19.0.0- 2.8 MB/s | 7.4 MB 00:02 2024-04-25T20:35:59.906 INFO:teuthology.orchestra.run.smithi043.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T20:35:59.915 INFO:teuthology.orchestra.run.smithi195.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-04-25T20:35:59.958 INFO:teuthology.orchestra.run.smithi195.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-04-25T20:35:59.983 INFO:teuthology.orchestra.run.smithi195.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-04-25T20:36:00.008 INFO:teuthology.orchestra.run.smithi195.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 744 kB/s | 36 kB 00:00 2024-04-25T20:36:00.025 INFO:teuthology.orchestra.run.smithi195.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2024-04-25T20:36:00.067 INFO:teuthology.orchestra.run.smithi195.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.3 MB/s | 305 kB 00:00 2024-04-25T20:36:00.092 INFO:teuthology.orchestra.run.smithi195.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 887 kB/s | 58 kB 00:00 2024-04-25T20:36:00.182 INFO:teuthology.orchestra.run.smithi043.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-04-25T20:36:00.251 INFO:teuthology.orchestra.run.smithi195.stdout:(99/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-25T20:36:00.276 INFO:teuthology.orchestra.run.smithi195.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 451 kB/s | 94 kB 00:00 2024-04-25T20:36:00.301 INFO:teuthology.orchestra.run.smithi195.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 307 kB/s | 64 kB 00:00 2024-04-25T20:36:00.323 INFO:teuthology.orchestra.run.smithi043.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 687 kB/s | 309 kB 00:00 2024-04-25T20:36:00.327 INFO:teuthology.orchestra.run.smithi195.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-04-25T20:36:00.352 INFO:teuthology.orchestra.run.smithi195.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-04-25T20:36:00.357 INFO:teuthology.orchestra.run.smithi043.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-25T20:36:00.385 INFO:teuthology.orchestra.run.smithi195.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-04-25T20:36:00.399 INFO:teuthology.orchestra.run.smithi043.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-25T20:36:00.433 INFO:teuthology.orchestra.run.smithi043.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-04-25T20:36:00.483 INFO:teuthology.orchestra.run.smithi043.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 807 kB/s | 67 kB 00:00 2024-04-25T20:36:00.516 INFO:teuthology.orchestra.run.smithi043.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-25T20:36:00.536 INFO:teuthology.orchestra.run.smithi195.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 129 kB/s | 19 kB 00:00 2024-04-25T20:36:00.628 INFO:teuthology.orchestra.run.smithi195.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-04-25T20:36:00.670 INFO:teuthology.orchestra.run.smithi195.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-04-25T20:36:00.675 INFO:teuthology.orchestra.run.smithi043.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-25T20:36:00.694 INFO:teuthology.orchestra.run.smithi195.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-04-25T20:36:00.709 INFO:teuthology.orchestra.run.smithi043.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-25T20:36:00.720 INFO:teuthology.orchestra.run.smithi195.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-04-25T20:36:00.745 INFO:teuthology.orchestra.run.smithi195.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-25T20:36:00.762 INFO:teuthology.orchestra.run.smithi195.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-04-25T20:36:00.784 INFO:teuthology.orchestra.run.smithi043.stdout:(114/152): libarrow-9.0.0-10.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-04-25T20:36:00.810 INFO:teuthology.orchestra.run.smithi043.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 324 kB/s | 43 kB 00:00 2024-04-25T20:36:00.835 INFO:teuthology.orchestra.run.smithi043.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 257 kB/s | 32 kB 00:00 2024-04-25T20:36:00.846 INFO:teuthology.orchestra.run.smithi195.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-25T20:36:00.860 INFO:teuthology.orchestra.run.smithi043.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-04-25T20:36:00.880 INFO:teuthology.orchestra.run.smithi195.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-04-25T20:36:00.905 INFO:teuthology.orchestra.run.smithi195.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-04-25T20:36:00.919 INFO:teuthology.orchestra.run.smithi043.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T20:36:00.930 INFO:teuthology.orchestra.run.smithi195.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-04-25T20:36:00.944 INFO:teuthology.orchestra.run.smithi043.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-25T20:36:00.955 INFO:teuthology.orchestra.run.smithi195.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 296 kB/s | 15 kB 00:00 2024-04-25T20:36:00.969 INFO:teuthology.orchestra.run.smithi043.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-25T20:36:00.981 INFO:teuthology.orchestra.run.smithi195.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-25T20:36:00.986 INFO:teuthology.orchestra.run.smithi043.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 526 kB/s | 35 kB 00:00 2024-04-25T20:36:01.023 INFO:teuthology.orchestra.run.smithi195.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-25T20:36:01.028 INFO:teuthology.orchestra.run.smithi043.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-25T20:36:01.048 INFO:teuthology.orchestra.run.smithi195.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-25T20:36:01.073 INFO:teuthology.orchestra.run.smithi195.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 704 kB/s | 35 kB 00:00 2024-04-25T20:36:01.132 INFO:teuthology.orchestra.run.smithi195.stdout:(121/152): libarrow-9.0.0-10.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-04-25T20:36:01.157 INFO:teuthology.orchestra.run.smithi195.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-04-25T20:36:01.162 INFO:teuthology.orchestra.run.smithi043.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T20:36:01.183 INFO:teuthology.orchestra.run.smithi195.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-25T20:36:01.187 INFO:teuthology.orchestra.run.smithi043.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 67 kB/s | 11 kB 00:00 2024-04-25T20:36:01.208 INFO:teuthology.orchestra.run.smithi195.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-04-25T20:36:01.212 INFO:teuthology.orchestra.run.smithi043.stdout:(125/152): python3-grpcio-tools-1.46.7-10.el9.x 640 kB/s | 144 kB 00:00 2024-04-25T20:36:01.233 INFO:teuthology.orchestra.run.smithi195.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-25T20:36:01.237 INFO:teuthology.orchestra.run.smithi043.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-25T20:36:01.258 INFO:teuthology.orchestra.run.smithi195.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-25T20:36:01.263 INFO:teuthology.orchestra.run.smithi043.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-04-25T20:36:01.284 INFO:teuthology.orchestra.run.smithi195.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-25T20:36:01.288 INFO:teuthology.orchestra.run.smithi043.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T20:36:01.309 INFO:teuthology.orchestra.run.smithi195.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-04-25T20:36:01.313 INFO:teuthology.orchestra.run.smithi043.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-25T20:36:01.355 INFO:teuthology.orchestra.run.smithi043.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-25T20:36:01.376 INFO:teuthology.orchestra.run.smithi195.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 6.7 MB/s | 2.0 MB 00:00 2024-04-25T20:36:01.380 INFO:teuthology.orchestra.run.smithi043.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-25T20:36:01.401 INFO:teuthology.orchestra.run.smithi195.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-04-25T20:36:01.406 INFO:teuthology.orchestra.run.smithi043.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-04-25T20:36:01.426 INFO:teuthology.orchestra.run.smithi195.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T20:36:01.431 INFO:teuthology.orchestra.run.smithi043.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-04-25T20:36:01.452 INFO:teuthology.orchestra.run.smithi195.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-25T20:36:01.465 INFO:teuthology.orchestra.run.smithi043.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-25T20:36:01.490 INFO:teuthology.orchestra.run.smithi043.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-25T20:36:01.494 INFO:teuthology.orchestra.run.smithi195.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-04-25T20:36:01.515 INFO:teuthology.orchestra.run.smithi043.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-25T20:36:01.519 INFO:teuthology.orchestra.run.smithi195.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-25T20:36:01.536 INFO:teuthology.orchestra.run.smithi195.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-25T20:36:01.540 INFO:teuthology.orchestra.run.smithi043.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-25T20:36:01.561 INFO:teuthology.orchestra.run.smithi195.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T20:36:01.566 INFO:teuthology.orchestra.run.smithi043.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T20:36:01.578 INFO:teuthology.orchestra.run.smithi195.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-04-25T20:36:01.591 INFO:teuthology.orchestra.run.smithi043.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T20:36:01.594 INFO:teuthology.orchestra.run.smithi195.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-04-25T20:36:01.617 INFO:teuthology.orchestra.run.smithi043.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-04-25T20:36:01.620 INFO:teuthology.orchestra.run.smithi195.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-25T20:36:01.637 INFO:teuthology.orchestra.run.smithi195.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-04-25T20:36:01.642 INFO:teuthology.orchestra.run.smithi043.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-25T20:36:01.654 INFO:teuthology.orchestra.run.smithi195.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-25T20:36:01.667 INFO:teuthology.orchestra.run.smithi043.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-04-25T20:36:01.671 INFO:teuthology.orchestra.run.smithi195.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-25T20:36:01.696 INFO:teuthology.orchestra.run.smithi195.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-25T20:36:01.700 INFO:teuthology.orchestra.run.smithi043.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-25T20:36:01.721 INFO:teuthology.orchestra.run.smithi195.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-25T20:36:01.726 INFO:teuthology.orchestra.run.smithi043.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-25T20:36:01.747 INFO:teuthology.orchestra.run.smithi195.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-04-25T20:36:01.751 INFO:teuthology.orchestra.run.smithi043.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T20:36:01.772 INFO:teuthology.orchestra.run.smithi195.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-25T20:36:01.785 INFO:teuthology.orchestra.run.smithi043.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 237 kB/s | 20 kB 00:00 2024-04-25T20:36:01.798 INFO:teuthology.orchestra.run.smithi195.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-25T20:36:01.810 INFO:teuthology.orchestra.run.smithi043.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T20:36:01.852 INFO:teuthology.orchestra.run.smithi043.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T20:36:01.919 INFO:teuthology.orchestra.run.smithi043.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T20:36:01.923 INFO:teuthology.orchestra.run.smithi195.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-04-25T20:36:02.006 INFO:teuthology.orchestra.run.smithi195.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-04-25T20:36:02.011 INFO:teuthology.orchestra.run.smithi043.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-25T20:36:02.123 INFO:teuthology.orchestra.run.smithi195.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T20:36:02.278 INFO:teuthology.orchestra.run.smithi043.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 6.9 MB/s | 3.4 MB 00:00 2024-04-25T20:36:02.365 INFO:teuthology.orchestra.run.smithi195.stdout:(151/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 5.5 MB/s | 3.1 MB 00:00 2024-04-25T20:36:02.770 INFO:teuthology.orchestra.run.smithi043.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 3.3 MB/s | 3.1 MB 00:00 2024-04-25T20:36:02.774 INFO:teuthology.orchestra.run.smithi195.stdout:(152/152): librados2-19.0.0-3156.gd69f13d8.el7. 3.4 MB/s | 3.4 MB 00:01 2024-04-25T20:36:02.778 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T20:36:02.778 INFO:teuthology.orchestra.run.smithi043.stdout:Total 10 MB/s | 222 MB 00:21 2024-04-25T20:36:02.778 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-25T20:36:02.779 INFO:teuthology.orchestra.run.smithi195.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-25T20:36:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-25T20:36:03.449 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T20:36:03.495 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T20:36:03.616 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T20:36:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T20:36:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T20:36:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T20:36:03.873 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-25T20:36:03.883 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-25T20:36:04.024 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-25T20:36:04.024 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-25T20:36:04.031 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-25T20:36:04.032 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-25T20:36:04.146 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T20:36:04.243 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:04.356 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:04.386 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:04.476 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:04.515 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:04.662 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T20:36:04.712 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T20:36:04.740 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:04.843 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:04.866 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:04.948 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:04.976 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:04.996 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:05.150 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:05.184 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:05.292 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T20:36:05.386 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T20:36:05.424 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T20:36:05.459 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T20:36:05.522 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T20:36:05.558 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T20:36:05.602 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T20:36:05.643 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T20:36:05.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T20:36:05.747 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T20:36:05.773 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-25T20:36:05.773 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-25T20:36:05.801 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T20:36:05.832 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T20:36:05.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T20:36:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-25T20:36:05.900 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-25T20:36:05.943 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T20:36:05.978 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T20:36:06.021 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T20:36:06.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T20:36:06.119 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T20:36:06.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T20:36:06.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T20:36:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T20:36:06.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T20:36:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T20:36:07.028 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T20:36:07.059 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T20:36:07.101 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T20:36:07.140 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T20:36:07.181 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T20:36:07.358 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T20:36:07.426 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T20:36:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T20:36:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T20:36:07.602 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T20:36:07.639 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T20:36:07.685 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T20:36:07.721 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T20:36:07.764 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T20:36:07.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T20:36:07.942 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T20:36:07.995 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T20:36:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T20:36:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T20:36:08.177 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T20:36:08.217 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T20:36:08.257 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T20:36:08.283 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T20:36:08.308 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T20:36:08.381 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T20:36:08.509 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T20:36:08.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T20:36:08.585 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T20:36:08.619 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T20:36:08.659 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T20:36:08.690 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T20:36:08.900 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T20:36:08.997 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T20:36:09.038 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T20:36:09.080 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T20:36:09.114 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T20:36:09.203 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T20:36:09.253 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T20:36:09.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T20:36:09.331 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T20:36:09.429 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T20:36:09.486 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T20:36:10.197 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T20:36:10.241 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T20:36:10.274 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T20:36:10.372 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T20:36:10.424 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T20:36:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T20:36:10.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T20:36:10.754 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T20:36:10.783 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T20:36:10.861 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T20:36:11.495 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T20:36:11.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T20:36:11.762 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-25T20:36:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T20:36:11.899 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T20:36:11.969 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T20:36:11.979 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-25T20:36:12.003 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T20:36:12.028 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T20:36:12.070 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T20:36:12.098 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T20:36:12.281 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T20:36:12.336 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T20:36:12.375 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T20:36:12.390 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T20:36:12.400 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T20:36:12.445 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T20:36:12.496 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:12.618 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:12.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:12.738 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:12.768 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:12.799 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T20:36:12.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T20:36:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T20:36:12.910 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T20:36:12.910 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T20:36:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T20:36:12.956 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T20:36:12.984 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:13.034 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:13.060 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:13.088 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:13.110 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:13.152 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:13.173 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:13.190 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:13.195 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:13.214 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:13.260 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T20:36:13.303 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:13.346 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T20:36:13.386 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:13.393 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:13.395 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T20:36:13.419 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:13.423 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:13.424 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T20:36:13.460 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T20:36:13.526 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T20:36:13.528 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:13.557 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:13.620 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T20:36:13.621 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T20:36:13.642 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:13.652 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T20:36:13.668 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T20:36:13.687 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T20:36:13.760 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T20:36:13.795 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T20:36:13.839 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T20:36:13.860 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:13.871 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T20:36:13.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T20:36:13.898 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T20:36:13.939 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T20:36:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:13.970 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T20:36:14.004 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T20:36:14.052 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:14.074 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T20:36:14.099 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T20:36:14.141 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T20:36:14.176 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T20:36:14.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T20:36:14.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T20:36:14.253 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T20:36:14.278 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T20:36:14.292 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T20:36:14.336 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T20:36:14.355 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T20:36:14.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T20:36:14.393 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T20:36:14.421 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T20:36:14.432 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T20:36:14.461 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T20:36:14.493 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T20:36:14.531 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T20:36:14.544 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T20:36:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T20:36:14.576 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T20:36:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T20:36:14.650 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T20:36:14.704 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T20:36:14.753 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T20:36:14.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T20:36:14.806 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T20:36:14.834 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T20:36:14.835 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T20:36:14.906 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T20:36:14.949 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T20:36:15.025 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T20:36:15.162 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T20:36:15.228 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T20:36:15.351 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T20:36:15.433 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T20:36:15.461 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T20:36:15.504 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T20:36:15.542 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T20:36:15.583 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T20:36:15.754 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T20:36:15.778 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T20:36:15.811 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T20:36:15.858 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T20:36:15.866 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T20:36:15.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T20:36:15.930 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T20:36:15.936 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T20:36:15.963 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T20:36:15.974 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T20:36:15.999 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T20:36:16.016 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T20:36:16.047 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T20:36:16.081 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T20:36:16.124 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T20:36:16.167 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T20:36:16.173 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T20:36:16.219 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T20:36:16.275 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T20:36:16.301 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T20:36:16.346 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T20:36:16.349 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T20:36:16.350 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T20:36:16.386 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T20:36:16.396 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T20:36:16.422 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T20:36:16.470 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T20:36:16.505 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T20:36:16.513 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T20:36:16.549 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T20:36:16.561 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T20:36:16.591 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T20:36:16.600 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T20:36:16.626 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T20:36:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T20:36:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T20:36:16.735 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T20:36:16.780 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T20:36:16.810 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T20:36:16.852 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T20:36:16.852 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T20:36:16.891 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T20:36:16.919 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T20:36:16.935 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:16.954 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T20:36:16.958 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T20:36:16.983 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:16.985 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T20:36:16.993 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T20:36:17.017 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T20:36:17.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T20:36:17.050 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T20:36:17.075 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T20:36:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:17.076 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T20:36:17.076 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T20:36:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:17.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T20:36:17.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T20:36:17.292 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T20:36:17.323 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T20:36:17.324 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T20:36:17.353 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T20:36:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T20:36:17.387 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T20:36:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T20:36:17.426 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T20:36:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T20:36:17.466 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T20:36:17.495 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T20:36:17.523 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T20:36:17.530 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T20:36:17.563 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T20:36:17.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T20:36:17.605 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T20:36:17.635 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T20:36:17.639 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T20:36:17.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T20:36:17.730 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T20:36:17.779 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T20:36:17.790 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T20:36:17.810 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T20:36:17.845 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T20:36:17.858 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T20:36:17.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T20:36:18.037 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T20:36:18.562 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T20:36:18.609 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T20:36:18.642 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T20:36:18.740 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T20:36:18.794 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T20:36:18.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T20:36:18.842 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T20:36:18.875 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T20:36:18.887 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T20:36:18.928 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T20:36:18.977 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T20:36:19.026 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T20:36:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T20:36:19.107 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T20:36:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T20:36:19.144 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T20:36:19.213 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T20:36:19.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T20:36:19.358 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T20:36:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T20:36:19.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T20:36:19.973 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T20:36:20.149 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T20:36:20.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T20:36:21.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T20:36:21.271 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T20:36:21.299 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T20:36:21.332 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T20:36:21.559 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T20:36:21.638 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T20:36:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T20:36:21.666 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T20:36:21.687 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:21.699 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T20:36:21.777 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:21.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T20:36:21.844 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T20:36:22.028 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T20:36:22.070 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:22.162 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T20:36:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T20:36:22.229 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T20:36:22.324 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T20:36:22.348 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:22.435 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:22.458 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T20:36:22.734 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T20:36:22.765 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:22.837 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T20:36:22.866 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T20:36:24.747 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:24.788 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:25.231 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:25.273 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:25.329 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:25.451 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:25.453 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T20:36:25.453 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T20:36:25.453 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:25.484 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:25.843 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T20:36:25.891 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:25.985 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T20:36:25.985 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T20:36:25.985 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T20:36:25.985 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:26.018 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-04-25T20:36:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:28.681 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:28.698 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:28.698 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T20:36:28.698 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:30.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:30.193 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:30.418 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:30.440 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:30.440 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:30.440 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T20:36:30.441 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:30.441 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:30.441 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:30.877 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:30.899 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:30.899 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:30.900 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T20:36:30.900 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:30.900 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:30.900 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:30.998 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T20:36:31.046 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T20:36:31.101 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T20:36:31.293 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T20:36:31.344 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T20:36:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T20:36:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:31.665 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:31.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T20:36:31.735 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T20:36:31.763 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T20:36:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:32.268 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T20:36:32.329 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T20:36:32.368 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:33.401 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:34.393 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:34.420 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:34.521 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:34.691 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T20:36:34.722 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:34.745 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:34.798 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:34.808 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T20:36:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T20:36:35.882 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T20:36:35.917 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:35.940 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:35.984 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:36.006 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:36.006 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:36.006 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T20:36:36.007 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:36.052 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:36.394 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:36.417 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-25T20:36:36.831 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-04-25T20:36:36.832 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-25T20:36:36.832 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:37.005 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:37.022 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:37.022 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:37.022 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T20:36:37.022 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:37.869 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-04-25T20:36:37.870 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:38.056 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T20:36:38.072 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:38.072 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T20:36:38.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:38.509 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:38.535 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:38.767 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:38.790 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:38.790 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:38.790 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T20:36:38.790 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:38.790 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:38.791 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:39.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:39.266 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:39.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T20:36:39.421 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T20:36:39.476 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T20:36:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T20:36:39.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:39.662 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T20:36:39.710 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T20:36:39.787 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T20:36:39.884 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:39.885 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:39.909 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T20:36:39.909 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:39.909 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T20:36:39.909 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:39.910 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T20:36:39.910 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:40.024 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:40.069 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T20:36:40.100 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T20:36:40.128 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T20:36:40.369 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T20:36:40.392 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:40.500 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T20:36:40.557 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T20:36:40.579 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:40.610 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:40.623 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T20:36:40.642 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T20:36:40.704 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T20:36:40.750 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:40.817 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T20:36:40.871 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T20:36:40.952 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T20:36:41.006 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T20:36:41.040 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:41.047 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T20:36:41.088 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T20:36:41.120 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T20:36:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T20:36:41.182 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:41.229 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T20:36:41.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T20:36:41.297 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T20:36:41.326 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T20:36:41.377 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T20:36:41.407 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T20:36:41.735 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:41.762 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T20:36:41.791 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:41.795 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T20:36:41.827 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:41.858 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T20:36:41.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:42.024 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:42.071 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:42.091 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:42.793 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:42.915 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T20:36:42.921 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:42.991 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T20:36:43.010 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T20:36:43.046 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:43.050 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T20:36:43.081 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T20:36:43.104 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:43.127 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:43.130 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T20:36:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T20:36:43.164 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:43.172 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:43.183 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:43.248 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:43.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T20:36:43.281 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:43.281 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:43.337 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T20:36:43.375 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:43.447 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:44.063 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T20:36:44.095 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:44.203 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T20:36:44.260 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T20:36:44.291 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:44.313 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:44.313 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:44.314 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T20:36:44.314 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:44.314 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:44.314 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:44.375 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T20:36:44.377 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:44.399 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:44.399 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:44.399 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T20:36:44.399 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:44.406 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:44.429 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T20:36:44.429 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:44.429 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T20:36:44.430 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:44.430 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T20:36:44.430 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:44.450 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:44.472 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:44.473 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:44.473 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T20:36:44.473 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:44.473 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:44.473 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:44.481 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:44.492 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T20:36:44.595 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T20:36:44.648 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T20:36:44.776 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:44.799 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:45.624 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T20:36:45.651 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:45.674 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T20:36:45.674 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:45.674 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T20:36:45.674 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:45.675 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T20:36:45.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:45.718 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:45.741 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T20:36:45.741 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:45.741 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T20:36:45.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:45.794 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:45.817 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T20:36:45.818 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:45.818 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T20:36:45.818 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:45.818 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T20:36:45.818 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:46.136 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T20:36:46.160 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:36:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T20:36:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T20:36:49.486 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T20:36:49.518 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T20:36:49.546 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:49.594 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T20:36:49.595 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T20:36:49.596 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T20:36:49.607 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T20:36:49.608 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T20:36:49.609 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T20:36:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T20:36:49.611 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T20:36:49.612 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T20:36:49.613 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T20:36:49.614 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T20:36:49.615 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:49.616 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T20:36:49.726 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T20:36:49.767 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T20:36:49.797 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T20:36:50.402 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:50.436 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:50.456 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:51.023 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T20:36:51.065 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T20:36:51.106 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T20:36:51.137 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T20:36:51.165 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T20:36:51.286 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T20:36:51.360 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T20:36:51.366 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T20:36:51.403 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T20:36:51.407 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T20:36:51.423 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T20:36:51.489 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T20:36:51.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T20:36:51.520 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:51.575 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T20:36:51.578 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T20:36:51.579 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T20:36:51.580 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.581 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T20:36:51.582 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T20:36:51.583 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T20:36:51.584 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T20:36:51.585 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T20:36:51.586 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T20:36:51.587 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T20:36:51.588 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-25T20:36:51.588 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-25T20:36:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:51.810 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:52.003 DEBUG:teuthology.parallel:result is None 2024-04-25T20:36:52.047 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:52.088 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:52.108 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T20:36:53.011 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T20:36:53.101 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T20:36:53.143 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T20:36:53.236 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T20:36:53.264 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T20:36:53.264 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:53.340 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T20:36:53.381 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:53.381 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:53.457 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T20:36:53.524 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:57.723 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:57.723 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T20:36:57.723 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T20:36:57.723 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T20:36:57.723 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T20:36:57.724 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T20:36:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T20:36:57.737 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T20:36:57.738 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T20:36:57.739 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T20:36:57.740 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T20:36:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T20:36:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T20:36:57.743 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:57.744 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T20:36:57.745 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T20:36:57.746 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T20:36:57.747 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T20:36:57.747 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T20:36:57.747 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T20:36:57.747 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:57.747 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T20:36:59.325 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T20:36:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T20:36:59.327 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T20:36:59.328 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T20:36:59.329 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T20:36:59.330 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T20:36:59.331 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T20:36:59.332 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T20:36:59.333 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T20:36:59.334 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T20:36:59.335 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T20:36:59.336 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T20:36:59.337 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T20:36:59.338 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T20:36:59.339 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T20:36:59.339 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T20:36:59.339 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T20:36:59.339 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T20:36:59.339 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-25T20:36:59.765 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.766 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.767 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.768 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T20:36:59.769 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T20:36:59.770 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T20:36:59.771 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T20:36:59.772 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T20:36:59.773 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T20:36:59.774 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T20:36:59.775 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T20:36:59.776 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T20:36:59.777 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:36:59.777 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-25T20:37:00.143 DEBUG:teuthology.parallel:result is None 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-04-25T20:37:01.405 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.406 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T20:37:01.407 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.408 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T20:37:01.409 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T20:37:01.410 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T20:37:01.411 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T20:37:01.412 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T20:37:01.413 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T20:37:01.414 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T20:37:01.415 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:37:01.416 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-25T20:37:01.813 DEBUG:teuthology.parallel:result is None 2024-04-25T20:37:01.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:02.038 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T20:37:02.062 INFO:teuthology.orchestra.run.smithi043.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.063 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.063 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T20:37:02.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:02.220 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T20:37:02.245 INFO:teuthology.orchestra.run.smithi112.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.246 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.246 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T20:37:02.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:02.387 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T20:37:02.409 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.409 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T20:37:02.409 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T20:37:02.411 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T20:37:02.411 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:37:02.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T20:37:02.441 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:37:02.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T20:37:02.471 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:37:02.472 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T20:37:02.497 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T20:37:02.497 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:37:02.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T20:37:02.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T20:37:02.587 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:37:02.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T20:37:02.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T20:37:02.681 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:37:02.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T20:37:02.705 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T20:37:02.768 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T20:37:02.768 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:37:02.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T20:37:02.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T20:37:02.856 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:37:02.856 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T20:37:02.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T20:37:02.951 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:37:02.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T20:37:02.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T20:37:03.038 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T20:37:03.039 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:37:03.039 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T20:37:03.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T20:37:03.129 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:37:03.129 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T20:37:03.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T20:37:03.216 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:37:03.216 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T20:37:03.240 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T20:37:03.303 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T20:37:03.407 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-25T20:37:03.407 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:03.407 INFO:tasks.cephadm:Cluster fsid is 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:37:03.407 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T20:37:03.408 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.43', 'mon.b': '172.21.15.112', 'mon.c': '172.21.15.195'} 2024-04-25T20:37:03.408 INFO:tasks.cephadm:First mon is mon.a on smithi043 2024-04-25T20:37:03.408 INFO:tasks.cephadm:First mgr is x 2024-04-25T20:37:03.408 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T20:37:03.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname $(hostname -s) 2024-04-25T20:37:03.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-04-25T20:37:03.456 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-04-25T20:37:03.480 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-25T20:37:03.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:03.622 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78795/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3156-gd69f13d8', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3156.gd69f13d8'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-22 12:00:06.590653', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-25T20:37:03.758 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-lusov-quiescer, sha1 d69f13d827952bb07bb9b7973bca14f97d764d6f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:37:03.759 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm 2024-04-25T20:37:03.759 DEBUG:teuthology.orchestra.run.smithi043:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:04.413 INFO:teuthology.orchestra.run.smithi043.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 25 20:37 /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:04.413 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:04.844 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 25 20:37 /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:04.844 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:05.437 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r--. 1 ubuntu ubuntu 781541 Apr 25 20:37 /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:05.437 DEBUG:teuthology.orchestra.run.smithi043:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:05.457 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:05.475 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T20:37:05.510 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f on all hosts... 2024-04-25T20:37:05.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-25T20:37:05.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-25T20:37:05.518 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f pull 2024-04-25T20:37:07.012 INFO:teuthology.orchestra.run.smithi043.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-25T20:37:07.159 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-25T20:37:07.223 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-25T20:37:44.852 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout: "repo_digests": [ 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T20:37:45.419 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76", 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4" 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-25T20:37:50.542 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T20:37:50.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph 2024-04-25T20:37:50.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-04-25T20:37:50.625 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-04-25T20:37:50.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /etc/ceph 2024-04-25T20:37:50.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-04-25T20:37:50.708 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-04-25T20:37:50.735 INFO:tasks.cephadm:Writing seed config... 2024-04-25T20:37:50.736 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-25T20:37:50.737 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T20:37:50.738 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T20:37:50.739 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T20:37:50.740 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-25T20:37:50.740 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-25T20:37:50.740 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:37:50.740 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T20:37:50.757 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 92e6f50e-0343-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T20:37:50.758 DEBUG:teuthology.orchestra.run.smithi043:mon.a> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service 2024-04-25T20:37:50.800 DEBUG:teuthology.orchestra.run.smithi043:mgr.x> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x.service 2024-04-25T20:37:50.842 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T20:37:50.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f -v bootstrap --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.43 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T20:37:51.043 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-25T20:37:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f', '-v', 'bootstrap', '--fsid', '92e6f50e-0343-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.43', '--skip-admin-label'] 2024-04-25T20:37:51.044 INFO:teuthology.orchestra.run.smithi043.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T20:37:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying podman|docker is present... 2024-04-25T20:37:51.080 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T20:37:51.081 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying lvm2 is present... 2024-04-25T20:37:51.081 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying time synchronization is in place... 2024-04-25T20:37:51.088 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T20:37:51.088 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T20:37:51.095 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T20:37:51.095 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:37:51.102 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-04-25T20:37:51.109 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-04-25T20:37:51.109 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-04-25T20:37:51.109 INFO:teuthology.orchestra.run.smithi043.stdout:Repeating the final host check... 2024-04-25T20:37:51.134 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T20:37:51.134 INFO:teuthology.orchestra.run.smithi043.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T20:37:51.134 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl is present 2024-04-25T20:37:51.134 INFO:teuthology.orchestra.run.smithi043.stdout:lvcreate is present 2024-04-25T20:37:51.141 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T20:37:51.141 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T20:37:51.147 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T20:37:51.147 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:37:51.154 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout enabled 2024-04-25T20:37:51.161 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout active 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Unit chronyd.service is enabled and running 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Host looks OK 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Cluster fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Acquiring lock 139958606064800 on /run/cephadm/92e6f50e-0343-11ef-bc93-c7b262605968.lock 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Lock 139958606064800 acquired on /run/cephadm/92e6f50e-0343-11ef-bc93-c7b262605968.lock 2024-04-25T20:37:51.162 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 3300 ... 2024-04-25T20:37:51.163 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying IP 172.21.15.43 port 6789 ... 2024-04-25T20:37:51.163 INFO:teuthology.orchestra.run.smithi043.stdout:Base mon IP(s) is [172.21.15.43:3300, 172.21.15.43:6789], mon addrv is [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-04-25T20:37:51.166 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.43 metric 100 2024-04-25T20:37:51.166 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.43 metric 100 2024-04-25T20:37:51.169 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T20:37:51.169 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-25T20:37:51.169 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-25T20:37:51.171 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-04-25T20:37:51.172 INFO:teuthology.orchestra.run.smithi043.stdout:Mon IP `172.21.15.43` is in CIDR network `172.21.0.0/20` 2024-04-25T20:37:51.173 INFO:teuthology.orchestra.run.smithi043.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T20:37:51.173 INFO:teuthology.orchestra.run.smithi043.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T20:37:51.174 INFO:teuthology.orchestra.run.smithi043.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stdout da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f... 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:7f03586bcf9c6a2b4d690c118c4aa5b771f9c6f252d75a20fb283dd07093a738 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Copying config sha256:da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 2024-04-25T20:37:51.780 INFO:teuthology.orchestra.run.smithi043.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T20:37:52.642 INFO:teuthology.orchestra.run.smithi043.stdout:ceph: stdout ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-25T20:37:52.642 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph version: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev) 2024-04-25T20:37:52.642 INFO:teuthology.orchestra.run.smithi043.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T20:37:53.714 INFO:teuthology.orchestra.run.smithi043.stdout:stat: stdout 167 167 2024-04-25T20:37:53.714 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial keys... 2024-04-25T20:37:54.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQAivypmPIUwAhAAMMftOIYr/JLyvjJKXWNPpA== 2024-04-25T20:37:55.555 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQAivypmjuctORAAPWbmFLRMS/dY5P9+FcUd5A== 2024-04-25T20:37:56.496 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph-authtool: stdout AQAjvypmurIUNBAANr1d96CqhJL9Oo0+BMZKLw== 2024-04-25T20:37:56.497 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial monmap... 2024-04-25T20:37:57.444 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T20:37:57.444 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-25T20:37:57.444 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:37:57.444 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool for a [v2:172.21.15.43:3300,v1:172.21.15.43:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: set fsid to 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:37:57.445 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mon... 2024-04-25T20:37:58.400 INFO:teuthology.orchestra.run.smithi043.stdout:create mon.a on 2024-04-25T20:37:58.630 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T20:37:58.778 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T20:37:58.962 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target. 2024-04-25T20:37:58.962 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target. 2024-04-25T20:37:59.220 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a 2024-04-25T20:37:59.221 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-25T20:37:59.389 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target.wants/ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968@.service. 2024-04-25T20:37:59.894 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:37:59 smithi043 ceph-mon[28798]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T20:37:59.894 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:37:59 smithi043 bash[28778]: 731db45c169ddce429f116438394bc535ca323e01680271671190b64afa05368 2024-04-25T20:37:59.907 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T20:37:59.908 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T20:37:59.914 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T20:37:59.914 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:37:59.914 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T20:37:59.914 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T20:37:59.915 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon to start... 2024-04-25T20:37:59.915 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mon... 2024-04-25T20:38:00.206 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:37:59 smithi043 systemd[1]: Started Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:38:00.997 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: monmap epoch 1 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: last_changed 2024-04-25T20:37:56.803474+0000 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: min_mon_release 19 (squid) 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: election_strategy: 1 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: fsmap 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: mgrmap e1: no daemons active 2024-04-25T20:38:00.998 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:00 smithi043 ceph-mon[28798]: from='client.? 172.21.15.43:0/1893253493' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-25T20:38:01.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T20:38:01.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout id: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:01.006 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout services: 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.52679s) 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout data: 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de4612700 1 Processor -- start 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de4612700 1 -- start start 2024-04-25T20:38:01.007 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de4612700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de4612700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc107f40 con 0x7f0ddc107550 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de23ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de23ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34186/0 (socket says 172.21.15.43:34186) 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.306+0000 7f0de23ae700 1 -- 172.21.15.43:0/2107021324 learned_addr learned my addr 172.21.15.43:0/2107021324 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.307+0000 7f0de23ae700 1 -- 172.21.15.43:0/2107021324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc108750 con 0x7f0ddc107550 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.307+0000 7f0de23ae700 1 --2- 172.21.15.43:0/2107021324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80098a0 tx=0x7f0dd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd7cbbc6da3b06f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.307+0000 7f0de13ac700 1 -- 172.21.15.43:0/2107021324 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd8004160 con 0x7f0ddc107550 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.307+0000 7f0de13ac700 1 -- 172.21.15.43:0/2107021324 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd8004300 con 0x7f0ddc107550 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.307+0000 7f0de13ac700 1 -- 172.21.15.43:0/2107021324 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd80036a0 con 0x7f0ddc107550 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- 172.21.15.43:0/2107021324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 msgr2=0x7f0ddc107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 --2- 172.21.15.43:0/2107021324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80098a0 tx=0x7f0dd8009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- 172.21.15.43:0/2107021324 shutdown_connections 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 --2- 172.21.15.43:0/2107021324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc107970 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:01.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- 172.21.15.43:0/2107021324 >> 172.21.15.43:0/2107021324 conn(0x7f0ddc102b30 msgr2=0x7f0ddc104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- 172.21.15.43:0/2107021324 shutdown_connections 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- 172.21.15.43:0/2107021324 wait complete. 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 Processor -- start 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.308+0000 7f0de4612700 1 -- start start 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de4612700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de4612700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc108c80 con 0x7f0ddc107550 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de23ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de23ae700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34196/0 (socket says 172.21.15.43:34196) 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de23ae700 1 -- 172.21.15.43:0/1893253493 learned_addr learned my addr 172.21.15.43:0/1893253493 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de23ae700 1 -- 172.21.15.43:0/1893253493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc19c120 con 0x7f0ddc107550 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de23ae700 1 --2- 172.21.15.43:0/1893253493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000c00 tx=0x7f0dd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd8003db0 con 0x7f0ddc107550 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd8011630 con 0x7f0ddc107550 2024-04-25T20:38:01.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc19c3b0 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dd8011950 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.309+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc19f0a0 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.310+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0dd8011af0 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.310+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0dd801c450 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.310+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc0640a0 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.313+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0dd8004260 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.386+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f0ddc02e100 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.386+0000 7f0dd37fe700 1 -- 172.21.15.43:0/1893253493 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f0dd801b450 con 0x7f0ddc107550 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 msgr2=0x7f0ddc19bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 --2- 172.21.15.43:0/1893253493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000c00 tx=0x7f0dd8004750 comp rx=0 tx=0).stop 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 shutdown_connections 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 --2- 172.21.15.43:0/1893253493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ddc107550 0x7f0ddc19bbe0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:01.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 >> 172.21.15.43:0/1893253493 conn(0x7f0ddc102b30 msgr2=0x7f0ddc1928a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:01.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 shutdown_connections 2024-04-25T20:38:01.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:00.387+0000 7f0de4612700 1 -- 172.21.15.43:0/1893253493 wait complete. 2024-04-25T20:38:01.011 INFO:teuthology.orchestra.run.smithi043.stdout:mon is available 2024-04-25T20:38:01.011 INFO:teuthology.orchestra.run.smithi043.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T20:38:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:01 smithi043 ceph-mon[28798]: from='client.? 172.21.15.43:0/4150778150' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T20:38:02.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:01 smithi043 ceph-mon[28798]: from='client.? 172.21.15.43:0/4150778150' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T20:38:02.050 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:02.056 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.43:3300,v1:172.21.15.43:6789] 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T20:38:02.057 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.410+0000 7f05070f8700 1 Processor -- start 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.410+0000 7f05070f8700 1 -- start start 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.410+0000 7f05070f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.410+0000 7f05070f8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f050007bea0 con 0x7f0500109010 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f0504e94700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f0504e94700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34200/0 (socket says 172.21.15.43:34200) 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f0504e94700 1 -- 172.21.15.43:0/315803246 learned_addr learned my addr 172.21.15.43:0/315803246 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f0504e94700 1 -- 172.21.15.43:0/315803246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050010b940 con 0x7f0500109010 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f0504e94700 1 --2- 172.21.15.43:0/315803246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009e80 tx=0x7f04f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f0ed8181314776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f04ff7fe700 1 -- 172.21.15.43:0/315803246 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8017070 con 0x7f0500109010 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f04ff7fe700 1 -- 172.21.15.43:0/315803246 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8003a20 con 0x7f0500109010 2024-04-25T20:38:02.058 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.411+0000 7f04ff7fe700 1 -- 172.21.15.43:0/315803246 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8003d20 con 0x7f0500109010 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 -- 172.21.15.43:0/315803246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 msgr2=0x7f050010b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 --2- 172.21.15.43:0/315803246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009e80 tx=0x7f04f800b330 comp rx=0 tx=0).stop 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 -- 172.21.15.43:0/315803246 shutdown_connections 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 --2- 172.21.15.43:0/315803246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050010b400 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 -- 172.21.15.43:0/315803246 >> 172.21.15.43:0/315803246 conn(0x7f0500102a40 msgr2=0x7f0500104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 -- 172.21.15.43:0/315803246 shutdown_connections 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.412+0000 7f05070f8700 1 -- 172.21.15.43:0/315803246 wait complete. 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f05070f8700 1 Processor -- start 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f05070f8700 1 -- start start 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f05070f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f05070f8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f050010be10 con 0x7f0500109010 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f0504e94700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f0504e94700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34202/0 (socket says 172.21.15.43:34202) 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f0504e94700 1 -- 172.21.15.43:0/4150778150 learned_addr learned my addr 172.21.15.43:0/4150778150 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:02.059 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f0504e94700 1 -- 172.21.15.43:0/4150778150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050019c100 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f0504e94700 1 --2- 172.21.15.43:0/4150778150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f050007b2e0 tx=0x7f04f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.413+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8022020 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f8018040 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f8017070 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050019c390 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050019f080 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04f8025020 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.414+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04f800f050 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.415+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05000640a0 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.417+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f04f802c030 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.487+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f050019f280 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.490+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f04f801e480 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f04fdffb700 1 -- 172.21.15.43:0/4150778150 <== mon.0 v2:172.21.15.43:3300/0 8 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f04f8003a20 con 0x7f0500109010 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 msgr2=0x7f050019bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:02.060 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 --2- 172.21.15.43:0/4150778150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f050007b2e0 tx=0x7f04f8004ad0 comp rx=0 tx=0).stop 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 shutdown_connections 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 --2- 172.21.15.43:0/4150778150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0500109010 0x7f050019bbc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 >> 172.21.15.43:0/4150778150 conn(0x7f0500102a40 msgr2=0x7f0500103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 shutdown_connections 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:01.491+0000 7f05070f8700 1 -- 172.21.15.43:0/4150778150 wait complete. 2024-04-25T20:38:02.061 INFO:teuthology.orchestra.run.smithi043.stdout:Generating new minimal ceph.conf... 2024-04-25T20:38:03.077 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193f4e7700 1 Processor -- start 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193f4e7700 1 -- start start 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193f4e7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193f4e7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f193807c8c0 con 0x7f193807de40 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193d283700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193d283700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34214/0 (socket says 172.21.15.43:34214) 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193d283700 1 -- 172.21.15.43:0/2466357825 learned_addr learned my addr 172.21.15.43:0/2466357825 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.469+0000 7f193d283700 1 -- 172.21.15.43:0/2466357825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193807ca40 con 0x7f193807de40 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193d283700 1 --2- 172.21.15.43:0/2466357825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f19280098a0 tx=0x7f1928009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4737ba271a5f13ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f192ffff700 1 -- 172.21.15.43:0/2466357825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1928004160 con 0x7f193807de40 2024-04-25T20:38:03.078 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f192ffff700 1 -- 172.21.15.43:0/2466357825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1928004300 con 0x7f193807de40 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f192ffff700 1 -- 172.21.15.43:0/2466357825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1928011b20 con 0x7f193807de40 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193f4e7700 1 -- 172.21.15.43:0/2466357825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 msgr2=0x7f193807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193f4e7700 1 --2- 172.21.15.43:0/2466357825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f19280098a0 tx=0x7f1928009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193f4e7700 1 -- 172.21.15.43:0/2466357825 shutdown_connections 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193f4e7700 1 --2- 172.21.15.43:0/2466357825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193807c2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.470+0000 7f193f4e7700 1 -- 172.21.15.43:0/2466357825 >> 172.21.15.43:0/2466357825 conn(0x7f1938103cb0 msgr2=0x7f19381060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 -- 172.21.15.43:0/2466357825 shutdown_connections 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 -- 172.21.15.43:0/2466357825 wait complete. 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 Processor -- start 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 -- start start 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193f4e7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f193810eba0 con 0x7f193807de40 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193d283700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:03.079 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193d283700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34226/0 (socket says 172.21.15.43:34226) 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.471+0000 7f193d283700 1 -- 172.21.15.43:0/1445871848 learned_addr learned my addr 172.21.15.43:0/1445871848 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f193d283700 1 -- 172.21.15.43:0/1445871848 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193819eb50 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f193d283700 1 --2- 172.21.15.43:0/1445871848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f19280116a0 tx=0x7f1928011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1928003ab0 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1928003c50 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193819ede0 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1928019870 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193819f240 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f192802d430 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.472+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1928024780 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.473+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19380640a0 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.475+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1928011e20 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.547+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f19381a1ff0 con 0x7f193807de40 2024-04-25T20:38:03.080 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.547+0000 7f192e7fc700 1 -- 172.21.15.43:0/1445871848 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f192801ac00 con 0x7f193807de40 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 msgr2=0x7f193819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 --2- 172.21.15.43:0/1445871848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f19280116a0 tx=0x7f1928011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 shutdown_connections 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 --2- 172.21.15.43:0/1445871848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193807de40 0x7f193819e610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 >> 172.21.15.43:0/1445871848 conn(0x7f1938103cb0 msgr2=0x7f19381046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 shutdown_connections 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:02.548+0000 7f193f4e7700 1 -- 172.21.15.43:0/1445871848 wait complete. 2024-04-25T20:38:03.081 INFO:teuthology.orchestra.run.smithi043.stdout:Restarting the monitor... 2024-04-25T20:38:03.101 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:02 smithi043 ceph-mon[28798]: from='client.? 172.21.15.43:0/1445871848' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:38:03.359 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 systemd[1]: Stopping Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:38:03.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a[28794]: 2024-04-25T20:38:03.357+0000 7fe68fc8b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T20:38:03.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a[28794]: 2024-04-25T20:38:03.357+0000 7fe68fc8b700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T20:38:03.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 podman[29041]: 2024-04-25 20:38:03.552671417 +0000 UTC m=+0.305325600 container died 731db45c169ddce429f116438394bc535ca323e01680271671190b64afa05368 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T20:38:04.158 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 podman[29041]: 2024-04-25 20:38:03.94037589 +0000 UTC m=+0.693030051 container cleanup 731db45c169ddce429f116438394bc535ca323e01680271671190b64afa05368 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T20:38:04.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:03 smithi043 bash[29041]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a 2024-04-25T20:38:04.517 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:04 smithi043 podman[29056]: 2024-04-25 20:38:04.157955417 +0000 UTC m=+0.596748573 container remove 731db45c169ddce429f116438394bc535ca323e01680271671190b64afa05368 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-25T20:38:04.517 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:04 smithi043 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-25T20:38:04.517 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:04 smithi043 systemd[1]: Stopped Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:38:04.517 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:04 smithi043 systemd[1]: Starting Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:38:04.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:04 smithi043 podman[29149]: 2024-04-25 20:38:04.419642495 +0000 UTC m=+0.018760382 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:38:05.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:05 smithi043 podman[29149]: 2024-04-25 20:38:05.526066049 +0000 UTC m=+1.125183921 container create 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 podman[29149]: 2024-04-25 20:38:07.318250625 +0000 UTC m=+2.917368510 container init 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 podman[29149]: 2024-04-25 20:38:07.322246841 +0000 UTC m=+2.921364714 container start 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev), process ceph-mon, pid 2 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: pidfile_write: ignore empty --pid-file 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: load: jerasure load: lrc 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: RocksDB version: 7.9.2 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Git sha 0 2024-04-25T20:38:07.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Compile date 2024-04-22 10:57:25 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: DB SUMMARY 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: DB Session ID: S63WVUCU6O5ZYY8401BM 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: CURRENT file: CURRENT 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105602 ; 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.error_if_exists: 0 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.create_if_missing: 0 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.paranoid_checks: 1 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T20:38:07.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.env: 0x5555bc57fcc0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.info_log: 0x5555bde45be0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.statistics: (nil) 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.use_fsync: 0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_log_file_size: 0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_fallocate: 1 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T20:38:07.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.use_direct_reads: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.db_log_dir: 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.wal_dir: 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T20:38:07.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.write_buffer_manager: 0x5555bddd90e0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.unordered_write: 0 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.row_cache: None 2024-04-25T20:38:07.800 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.wal_filter: None 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.two_write_queues: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.wal_compression: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.atomic_flush: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.log_readahead_size: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T20:38:07.801 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_background_jobs: 2 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_background_compactions: -1 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_subcompactions: 1 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T20:38:07.802 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_open_files: -1 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_background_flushes: -1 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Compression algorithms supported: 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kZSTD supported: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kXpressCompression supported: 0 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kZlibCompression supported: 1 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kSnappyCompression supported: 1 2024-04-25T20:38:07.803 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kLZ4Compression supported: 1 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: kBZip2Compression supported: 0 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.merge_operator: 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_filter: None 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5555bde45dc0) 2024-04-25T20:38:07.804 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks: 1 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: pin_top_level_index_and_filter: 1 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_type: 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_index_type: 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_shortening: 1 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: checksum: 4 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: no_block_cache: 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache: 0x5555bde0b1f0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_name: BinnedLRUCache 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_options: 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: capacity : 536870912 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_shard_bits : 4 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: strict_capacity_limit : 0 2024-04-25T20:38:07.805 INFO:journalctl@ceph.mon.a.smithi043.stdout: high_pri_pool_ratio: 0.000 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_cache_compressed: (nil) 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: persistent_cache: (nil) 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size: 4096 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_size_deviation: 10 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_restart_interval: 16 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: index_block_restart_interval: 1 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: metadata_block_size: 4096 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: partition_filters: 0 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: use_delta_encoding: 1 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: filter_policy: bloomfilter 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: whole_key_filtering: 1 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: verify_compression: 0 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: read_amp_bytes_per_bit: 0 2024-04-25T20:38:07.806 INFO:journalctl@ceph.mon.a.smithi043.stdout: format_version: 5 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_index_compression: 1 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: block_align: 0 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: max_auto_readahead_size: 262144 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: prepopulate_block_cache: 0 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: initial_auto_readahead_size: 8192 2024-04-25T20:38:07.807 INFO:journalctl@ceph.mon.a.smithi043.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression: NoCompression 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.num_levels: 7 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T20:38:07.808 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T20:38:07.809 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T20:38:07.810 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T20:38:07.811 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T20:38:07.812 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T20:38:07.813 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T20:38:07.814 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.inplace_update_support: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.bloom_locality: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.max_successive_merges: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T20:38:07.815 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.ttl: 2592000 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enable_blob_files: false 2024-04-25T20:38:07.816 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.min_blob_size: 0 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T20:38:07.817 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e7306350-bb7d-4f86-9a1d-b005b3b9c154 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077487356696, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077487357874, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100689, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98573, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14288, "raw_average_key_size": 49, "raw_value_size": 90829, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714077487, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e7306350-bb7d-4f86-9a1d-b005b3b9c154", "db_session_id": "S63WVUCU6O5ZYY8401BM", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077487357948, "job": 1, "event": "recovery_finished"} 2024-04-25T20:38:07.818 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5555bdf20000 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: DB pointer 0x5555bdf0a000 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** DB Stats ** 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T20:38:07.819 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T20:38:07.820 INFO:journalctl@ceph.mon.a.smithi043.stdout: L0 2/0 100.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: Sum 2/0 100.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** Compaction Stats [default] ** 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T20:38:07.821 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T20:38:07.822 INFO:journalctl@ceph.mon.a.smithi043.stdout: Cumulative compaction: 0.00 GB write, 26.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: Interval compaction: 0.00 GB write, 26.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache BinnedLRUCache@0x5555bde0b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: starting mon.a rank 0 at public addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] at bind addrs [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???) e1 preinit fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).mds e1 new map 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).mds e1 print_map 2024-04-25T20:38:07.823 INFO:journalctl@ceph.mon.a.smithi043.stdout: e1 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout: legacy client fscid: -1 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout: 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout: No filesystems configured 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: monmap epoch 1 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: last_changed 2024-04-25T20:37:56.803474+0000 2024-04-25T20:38:07.824 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: min_mon_release 19 (squid) 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: election_strategy: 1 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: fsmap 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T20:38:07.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:07 smithi043 ceph-mon[29167]: mgrmap e1: no daemons active 2024-04-25T20:38:08.184 INFO:teuthology.orchestra.run.smithi043.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T20:38:08.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:08 smithi043 bash[29149]: 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef 2024-04-25T20:38:08.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:08 smithi043 systemd[1]: Started Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:38:12.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:12 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1426373028' entity='client.admin' 2024-04-25T20:38:15.828 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.445+0000 7faacbf90700 1 Processor -- start 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.445+0000 7faacbf90700 1 -- start start 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.445+0000 7faacbf90700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.445+0000 7faacbf90700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faac4109040 con 0x7faac4108650 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac9d2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac9d2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46902/0 (socket says 172.21.15.43:46902) 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac9d2c700 1 -- 172.21.15.43:0/4154127260 learned_addr learned my addr 172.21.15.43:0/4154127260 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac9d2c700 1 -- 172.21.15.43:0/4154127260 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac4109800 con 0x7faac4108650 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac9d2c700 1 --2- 172.21.15.43:0/4154127260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faac00098a0 tx=0x7faac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcec93c1ac2eed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac8d2a700 1 -- 172.21.15.43:0/4154127260 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0004160 con 0x7faac4108650 2024-04-25T20:38:15.834 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac8d2a700 1 -- 172.21.15.43:0/4154127260 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7faac0004300 con 0x7faac4108650 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.446+0000 7faac8d2a700 1 -- 172.21.15.43:0/4154127260 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0011b20 con 0x7faac4108650 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 -- 172.21.15.43:0/4154127260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 msgr2=0x7faac4108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 --2- 172.21.15.43:0/4154127260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faac00098a0 tx=0x7faac0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 -- 172.21.15.43:0/4154127260 shutdown_connections 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 --2- 172.21.15.43:0/4154127260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac4108a70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 -- 172.21.15.43:0/4154127260 >> 172.21.15.43:0/4154127260 conn(0x7faac4103cb0 msgr2=0x7faac41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 -- 172.21.15.43:0/4154127260 shutdown_connections 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.447+0000 7faacbf90700 1 -- 172.21.15.43:0/4154127260 wait complete. 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faacbf90700 1 Processor -- start 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faacbf90700 1 -- start start 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faacbf90700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:15.835 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faacbf90700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faac410cbb0 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faac9d2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faac9d2c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46918/0 (socket says 172.21.15.43:46918) 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faac9d2c700 1 -- 172.21.15.43:0/1426373028 learned_addr learned my addr 172.21.15.43:0/1426373028 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faac9d2c700 1 -- 172.21.15.43:0/1426373028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac419c960 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faac9d2c700 1 --2- 172.21.15.43:0/1426373028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faac0006af0 tx=0x7faac0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.448+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0003b90 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7faac0003d30 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac419cbf0 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac00197c0 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac419d050 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faac0022020 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.449+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faac0024df0 con 0x7faac4108650 2024-04-25T20:38:15.836 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.450+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac40640a0 con 0x7faac4108650 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.452+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faac00042e0 con 0x7faac4108650 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.522+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7faac419fa70 con 0x7faac4108650 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.524+0000 7faabaffd700 1 -- 172.21.15.43:0/1426373028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7faac001ac50 con 0x7faac4108650 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 msgr2=0x7faac419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 --2- 172.21.15.43:0/1426373028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7faac0006af0 tx=0x7faac0011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 shutdown_connections 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 --2- 172.21.15.43:0/1426373028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faac4108650 0x7faac419c420 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 >> 172.21.15.43:0/1426373028 conn(0x7faac4103cb0 msgr2=0x7faac41046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 shutdown_connections 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:11.525+0000 7faacbf90700 1 -- 172.21.15.43:0/1426373028 wait complete. 2024-04-25T20:38:15.837 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T20:38:15.857 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T20:38:15.857 INFO:teuthology.orchestra.run.smithi043.stdout:Creating mgr... 2024-04-25T20:38:15.858 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-25T20:38:15.858 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-25T20:38:16.112 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x 2024-04-25T20:38:16.112 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Failed to reset failed state of unit ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-25T20:38:16.261 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968.target.wants/ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-92e6f50e-0343-11ef-bc93-c7b262605968@.service. 2024-04-25T20:38:16.501 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 systemd[1]: Starting Ceph mgr.x for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:38:16.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 podman[29387]: 2024-04-25 20:38:16.403771391 +0000 UTC m=+0.018248914 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T20:38:16.795 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 podman[29387]: 2024-04-25 20:38:16.509805065 +0000 UTC m=+0.124282597 container create 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:38:16.795 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 podman[29387]: 2024-04-25 20:38:16.72020202 +0000 UTC m=+0.334679511 container init 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T20:38:16.795 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 podman[29387]: 2024-04-25 20:38:16.723060855 +0000 UTC m=+0.337538348 container start 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T20:38:16.827 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T20:38:16.828 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T20:38:16.835 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T20:38:16.835 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:38:16.835 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T20:38:16.835 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T20:38:16.843 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T20:38:16.844 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T20:38:16.851 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T20:38:16.851 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:38:16.851 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T20:38:16.852 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-25T20:38:16.852 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr to start... 2024-04-25T20:38:16.852 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr... 2024-04-25T20:38:17.079 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 bash[29387]: 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 2024-04-25T20:38:17.080 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 systemd[1]: Started Ceph mgr.x for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:38:17.080 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:16.884+0000 7f52e2a64200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:38:17.080 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:17.077+0000 7f52e2a64200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:38:17.352 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:17.188+0000 7f52e2a64200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:38:17.610 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:17 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3671530311' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T20:38:17.610 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:17.520+0000 7f52e2a64200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:38:17.610 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:17.608+0000 7f52e2a64200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:38:17.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T20:38:17.999 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T20:38:18.000 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T20:38:18.008 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T20:38:18.009 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T20:37:59.861571+0000", 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1e1cac700 1 Processor -- start 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1e1cac700 1 -- start start 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1e1cac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1e1cac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc109490 con 0x7fc1dc108aa0 2024-04-25T20:38:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48884/0 (socket says 172.21.15.43:48884) 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.350+0000 7fc1db7fe700 1 -- 172.21.15.43:0/2635957575 learned_addr learned my addr 172.21.15.43:0/2635957575 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.351+0000 7fc1db7fe700 1 -- 172.21.15.43:0/2635957575 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc109610 con 0x7fc1dc108aa0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.351+0000 7fc1db7fe700 1 --2- 172.21.15.43:0/2635957575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098a0 tx=0x7fc1cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b02bdfb3602fa8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.351+0000 7fc1da7fc700 1 -- 172.21.15.43:0/2635957575 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc004160 con 0x7fc1dc108aa0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.351+0000 7fc1da7fc700 1 -- 172.21.15.43:0/2635957575 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc1cc004300 con 0x7fc1dc108aa0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.351+0000 7fc1da7fc700 1 -- 172.21.15.43:0/2635957575 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc011b20 con 0x7fc1dc108aa0 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 -- 172.21.15.43:0/2635957575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 msgr2=0x7fc1dc108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 --2- 172.21.15.43:0/2635957575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098a0 tx=0x7fc1cc009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 -- 172.21.15.43:0/2635957575 shutdown_connections 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 --2- 172.21.15.43:0/2635957575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc108ec0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:18.012 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 -- 172.21.15.43:0/2635957575 >> 172.21.15.43:0/2635957575 conn(0x7fc1dc1021b0 msgr2=0x7fc1dc1045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 -- 172.21.15.43:0/2635957575 shutdown_connections 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.352+0000 7fc1e1cac700 1 -- 172.21.15.43:0/2635957575 wait complete. 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1e1cac700 1 Processor -- start 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1e1cac700 1 -- start start 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1e1cac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1e1cac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc1073a0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48894/0 (socket says 172.21.15.43:48894) 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.353+0000 7fc1db7fe700 1 -- 172.21.15.43:0/3671530311 learned_addr learned my addr 172.21.15.43:0/3671530311 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1db7fe700 1 -- 172.21.15.43:0/3671530311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc19eaa0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1db7fe700 1 --2- 172.21.15.43:0/3671530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0117e0 tx=0x7fc1cc011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc003b30 con 0x7fc1dc108aa0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc1cc003cd0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.013 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc19ed90 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1cc01a830 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc1a1a20 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1cc02d3f0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.354+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1cc019700 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.355+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1dc0640a0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.357+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc1cc042e50 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.432+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc1dc197ac0 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.432+0000 7fc1d8ff9700 1 -- 172.21.15.43:0/3671530311 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7fc1cc031020 con 0x7fc1dc108aa0 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.433+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 msgr2=0x7fc1dc19e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.433+0000 7fc1e1cac700 1 --2- 172.21.15.43:0/3671530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0117e0 tx=0x7fc1cc011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.433+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 shutdown_connections 2024-04-25T20:38:18.014 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.433+0000 7fc1e1cac700 1 --2- 172.21.15.43:0/3671530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1dc108aa0 0x7fc1dc19e560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:18.015 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.433+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 >> 172.21.15.43:0/3671530311 conn(0x7fc1dc1021b0 msgr2=0x7fc1dc194b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:18.015 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.434+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 shutdown_connections 2024-04-25T20:38:18.015 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:17.434+0000 7fc1e1cac700 1 -- 172.21.15.43:0/3671530311 wait complete. 2024-04-25T20:38:18.015 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (1/15)... 2024-04-25T20:38:19.230 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:18.877+0000 7f52e2a64200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:38:19.230 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:19.053+0000 7f52e2a64200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:38:19.230 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:19.228+0000 7f52e2a64200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:38:19.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:19.527+0000 7f52e2a64200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:38:19.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:19.622+0000 7f52e2a64200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:38:20.126 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:19.832+0000 7f52e2a64200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:38:20.126 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:20.036+0000 7f52e2a64200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:38:20.700 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:20 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/533721292' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T20:38:21.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:20.697+0000 7f52e2a64200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:38:21.424 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:21.149+0000 7f52e2a64200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:38:21.424 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:21.251+0000 7f52e2a64200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:38:21.505 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T20:38:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T20:38:21.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T20:38:21.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T20:38:21.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T20:38:21.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.520 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T20:38:21.521 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T20:37:59.861571+0000", 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:21.522 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.440+0000 7f17aa653700 1 Processor -- start 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.440+0000 7f17aa653700 1 -- start start 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.440+0000 7f17aa653700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.440+0000 7f17aa653700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17a4109000 con 0x7f17a4108610 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48906/0 (socket says 172.21.15.43:48906) 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a3fff700 1 -- 172.21.15.43:0/2276222536 learned_addr learned my addr 172.21.15.43:0/2276222536 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a3fff700 1 -- 172.21.15.43:0/2276222536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a41097c0 con 0x7f17a4108610 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a3fff700 1 --2- 172.21.15.43:0/2276222536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17940098a0 tx=0x7f1794009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcb396f4723695d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a2ffd700 1 -- 172.21.15.43:0/2276222536 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794004160 con 0x7f17a4108610 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a2ffd700 1 -- 172.21.15.43:0/2276222536 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1794004300 con 0x7f17a4108610 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.441+0000 7f17a2ffd700 1 -- 172.21.15.43:0/2276222536 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794011b20 con 0x7f17a4108610 2024-04-25T20:38:21.523 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 -- 172.21.15.43:0/2276222536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 msgr2=0x7f17a4108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 --2- 172.21.15.43:0/2276222536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17940098a0 tx=0x7f1794009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 -- 172.21.15.43:0/2276222536 shutdown_connections 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 --2- 172.21.15.43:0/2276222536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a4108a30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 -- 172.21.15.43:0/2276222536 >> 172.21.15.43:0/2276222536 conn(0x7f17a4103c10 msgr2=0x7f17a4106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 -- 172.21.15.43:0/2276222536 shutdown_connections 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.442+0000 7f17aa653700 1 -- 172.21.15.43:0/2276222536 wait complete. 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17aa653700 1 Processor -- start 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17aa653700 1 -- start start 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17aa653700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17aa653700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17a410cb70 con 0x7f17a4108610 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48922/0 (socket says 172.21.15.43:48922) 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.443+0000 7f17a3fff700 1 -- 172.21.15.43:0/533721292 learned_addr learned my addr 172.21.15.43:0/533721292 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17a3fff700 1 -- 172.21.15.43:0/533721292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a419eb00 con 0x7f17a4108610 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17a3fff700 1 --2- 172.21.15.43:0/533721292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17940117e0 tx=0x7f1794011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:21.524 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794003b30 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1794003cd0 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a419ed90 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179401a830 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.444+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a419f1f0 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.445+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f179402d3f0 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.445+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1794019700 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.445+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a40640a0 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.449+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1794024ba0 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.523+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f17a41a1c10 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.524+0000 7f17a17fa700 1 -- 172.21.15.43:0/533721292 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f1794033020 con 0x7f17a4108610 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.525+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 msgr2=0x7f17a419e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.525+0000 7f17aa653700 1 --2- 172.21.15.43:0/533721292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17940117e0 tx=0x7f1794011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.526+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 shutdown_connections 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.526+0000 7f17aa653700 1 --2- 172.21.15.43:0/533721292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a4108610 0x7f17a419e5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.526+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 >> 172.21.15.43:0/533721292 conn(0x7f17a4103c10 msgr2=0x7f17a4104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.526+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 shutdown_connections 2024-04-25T20:38:21.525 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:20.526+0000 7f17aa653700 1 -- 172.21.15.43:0/533721292 wait complete. 2024-04-25T20:38:21.526 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (2/15)... 2024-04-25T20:38:21.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:21.463+0000 7f52e2a64200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:38:22.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.021+0000 7f52e2a64200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:38:22.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.118+0000 7f52e2a64200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:38:22.732 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.374+0000 7f52e2a64200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:38:22.732 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.512+0000 7f52e2a64200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:38:22.732 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.611+0000 7f52e2a64200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:38:22.732 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:22.730+0000 7f52e2a64200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:38:23.545 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:23.042+0000 7f52e2a64200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:38:23.904 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:23.672+0000 7f52e2a64200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:38:23.904 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:23.902+0000 7f52e2a64200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:38:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: Activating manager daemon x 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: mgrmap e2: x(active, starting, since 0.0029974s) 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: Manager daemon x is now available 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' 2024-04-25T20:38:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:23 smithi043 ceph-mon[29167]: from='mgr.14100 172.21.15.43:0/4282285149' entity='mgr.x' 2024-04-25T20:38:24.596 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:24.597 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T20:38:24.598 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T20:38:24.606 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T20:38:24.607 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T20:37:59.861571+0000", 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1158498700 1 Processor -- start 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1158498700 1 -- start start 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1158498700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:24.608 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1158498700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f115007bea0 con 0x7f1150109010 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1156234700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1156234700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48974/0 (socket says 172.21.15.43:48974) 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.972+0000 7f1156234700 1 -- 172.21.15.43:0/4243936311 learned_addr learned my addr 172.21.15.43:0/4243936311 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1156234700 1 -- 172.21.15.43:0/4243936311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115010b940 con 0x7f1150109010 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1156234700 1 --2- 172.21.15.43:0/4243936311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f114c0098a0 tx=0x7f114c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c111b453de78591 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1155232700 1 -- 172.21.15.43:0/4243936311 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c004160 con 0x7f1150109010 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1155232700 1 -- 172.21.15.43:0/4243936311 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f114c004300 con 0x7f1150109010 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1155232700 1 -- 172.21.15.43:0/4243936311 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c011b20 con 0x7f1150109010 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1158498700 1 -- 172.21.15.43:0/4243936311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 msgr2=0x7f115010b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.973+0000 7f1158498700 1 --2- 172.21.15.43:0/4243936311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f114c0098a0 tx=0x7f114c009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- 172.21.15.43:0/4243936311 shutdown_connections 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 --2- 172.21.15.43:0/4243936311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115010b400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- 172.21.15.43:0/4243936311 >> 172.21.15.43:0/4243936311 conn(0x7f1150102a40 msgr2=0x7f1150104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- 172.21.15.43:0/4243936311 shutdown_connections 2024-04-25T20:38:24.609 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- 172.21.15.43:0/4243936311 wait complete. 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 Processor -- start 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- start start 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1158498700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f115010c970 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1156234700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1156234700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48978/0 (socket says 172.21.15.43:48978) 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.974+0000 7f1156234700 1 -- 172.21.15.43:0/2822386027 learned_addr learned my addr 172.21.15.43:0/2822386027 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f1156234700 1 -- 172.21.15.43:0/2822386027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115019c940 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f1156234700 1 --2- 172.21.15.43:0/2822386027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f114c0117e0 tx=0x7f114c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c003b30 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115019cbd0 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f114c003cd0 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c01a7c0 con 0x7f1150109010 2024-04-25T20:38:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.975+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115019d030 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.976+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 2) ==== 46314+0+0 (secure 0 0 0) 0x7f114c024440 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.976+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11500640a0 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.976+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f114c04d5e0 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:23.979+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f114c00e260 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.051+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f115019fa50 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f11477fe700 1 -- 172.21.15.43:0/2822386027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f115019fa50 con 0x7f1150109010 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 msgr2=0x7f115019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 --2- 172.21.15.43:0/2822386027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f114c0117e0 tx=0x7f114c011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 shutdown_connections 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 --2- 172.21.15.43:0/2822386027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1150109010 0x7f115019c400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 >> 172.21.15.43:0/2822386027 conn(0x7f1150102a40 msgr2=0x7f1150103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 shutdown_connections 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:24.052+0000 7f1158498700 1 -- 172.21.15.43:0/2822386027 wait complete. 2024-04-25T20:38:24.611 INFO:teuthology.orchestra.run.smithi043.stdout:mgr not available, waiting (3/15)... 2024-04-25T20:38:25.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:24 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2822386027' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T20:38:25.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:24 smithi043 ceph-mon[29167]: mgrmap e3: x(active, since 1.00756s) 2024-04-25T20:38:27.011 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:26 smithi043 ceph-mon[29167]: mgrmap e4: x(active, since 2s) 2024-04-25T20:38:28.173 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:27 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/60666563' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T20:38:28.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:28.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:28.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 0 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "quorum_age": 19, 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T20:38:28.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T20:38:28.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T20:38:28.188 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T20:38:28.188 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.189 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ], 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:28.190 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T20:37:59.861571+0000", 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout }, 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.038+0000 7effdbc2a700 1 Processor -- start 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effdbc2a700 1 -- start start 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effdbc2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effdbc2a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effd407be40 con 0x7effd4109090 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effd99c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effd99c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52432/0 (socket says 172.21.15.43:52432) 2024-04-25T20:38:28.191 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effd99c6700 1 -- 172.21.15.43:0/2578470833 learned_addr learned my addr 172.21.15.43:0/2578470833 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.039+0000 7effd99c6700 1 -- 172.21.15.43:0/2578470833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd410b9c0 con 0x7effd4109090 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effd99c6700 1 --2- 172.21.15.43:0/2578470833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7effd00098a0 tx=0x7effd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965e9d7de1f6bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effd89c4700 1 -- 172.21.15.43:0/2578470833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0004160 con 0x7effd4109090 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effd89c4700 1 -- 172.21.15.43:0/2578470833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7effd0004300 con 0x7effd4109090 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effd89c4700 1 -- 172.21.15.43:0/2578470833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0011b20 con 0x7effd4109090 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effdbc2a700 1 -- 172.21.15.43:0/2578470833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 msgr2=0x7effd410b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effdbc2a700 1 --2- 172.21.15.43:0/2578470833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7effd00098a0 tx=0x7effd0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effdbc2a700 1 -- 172.21.15.43:0/2578470833 shutdown_connections 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effdbc2a700 1 --2- 172.21.15.43:0/2578470833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd410b480 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.040+0000 7effdbc2a700 1 -- 172.21.15.43:0/2578470833 >> 172.21.15.43:0/2578470833 conn(0x7effd4102a80 msgr2=0x7effd4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 -- 172.21.15.43:0/2578470833 shutdown_connections 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 -- 172.21.15.43:0/2578470833 wait complete. 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 Processor -- start 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 -- start start 2024-04-25T20:38:28.192 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effdbc2a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effd410c990 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effd99c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effd99c6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52436/0 (socket says 172.21.15.43:52436) 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.041+0000 7effd99c6700 1 -- 172.21.15.43:0/60666563 learned_addr learned my addr 172.21.15.43:0/60666563 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effd99c6700 1 -- 172.21.15.43:0/60666563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd419c9b0 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effd99c6700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effd0006af0 tx=0x7effd0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd00039a0 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7effd0003b40 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd419cc40 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd0019670 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.042+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd419d0a0 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.043+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7effd001a430 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.043+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd40640a0 con 0x7effd4109090 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.043+0000 7effcaffd700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 0x7effc003bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:28.193 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.043+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7effd004da50 con 0x7effd4109090 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.043+0000 7effd91c5700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 0x7effc003bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.044+0000 7effd91c5700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 0x7effc003bae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.049+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7effd0011e20 con 0x7effd4109090 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.343+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7effd419fac0 con 0x7effd4109090 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.343+0000 7effcaffd700 1 -- 172.21.15.43:0/60666563 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7effd419fac0 con 0x7effd4109090 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 msgr2=0x7effc003bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 0x7effc003bae0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7effc4006fd0 tx=0x7effc4006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 msgr2=0x7effd419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effd0006af0 tx=0x7effd0011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 shutdown_connections 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7effc0039620 0x7effc003bae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 --2- 172.21.15.43:0/60666563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effd4109090 0x7effd419c470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.345+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 >> 172.21.15.43:0/60666563 conn(0x7effd4102a80 msgr2=0x7effd4103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.346+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 shutdown_connections 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:27.346+0000 7effdbc2a700 1 -- 172.21.15.43:0/60666563 wait complete. 2024-04-25T20:38:28.194 INFO:teuthology.orchestra.run.smithi043.stdout:mgr is available 2024-04-25T20:38:29.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:28 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4043392807' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout fsid = 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T20:38:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d22b45700 1 Processor -- start 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d22b45700 1 -- start start 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d22b45700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:29.423 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d22b45700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c07c7f0 con 0x7f3d1c07de00 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d208e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d208e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52438/0 (socket says 172.21.15.43:52438) 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d208e1700 1 -- 172.21.15.43:0/2339082663 learned_addr learned my addr 172.21.15.43:0/2339082663 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d208e1700 1 -- 172.21.15.43:0/2339082663 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c07c970 con 0x7f3d1c07de00 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.604+0000 7f3d208e1700 1 --2- 172.21.15.43:0/2339082663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d100098a0 tx=0x7f3d10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6a1bf596fb57f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d1b7fe700 1 -- 172.21.15.43:0/2339082663 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10004160 con 0x7f3d1c07de00 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d1b7fe700 1 -- 172.21.15.43:0/2339082663 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3d10004300 con 0x7f3d1c07de00 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d1b7fe700 1 -- 172.21.15.43:0/2339082663 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10011b20 con 0x7f3d1c07de00 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 -- 172.21.15.43:0/2339082663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 msgr2=0x7f3d1c07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 --2- 172.21.15.43:0/2339082663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d100098a0 tx=0x7f3d10009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 -- 172.21.15.43:0/2339082663 shutdown_connections 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 --2- 172.21.15.43:0/2339082663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c07c2b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 -- 172.21.15.43:0/2339082663 >> 172.21.15.43:0/2339082663 conn(0x7f3d1c103cb0 msgr2=0x7f3d1c1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:29.424 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 -- 172.21.15.43:0/2339082663 shutdown_connections 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.605+0000 7f3d22b45700 1 -- 172.21.15.43:0/2339082663 wait complete. 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d22b45700 1 Processor -- start 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d22b45700 1 -- start start 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d22b45700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d22b45700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c10eb80 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d208e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d208e1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52452/0 (socket says 172.21.15.43:52452) 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.606+0000 7f3d208e1700 1 -- 172.21.15.43:0/4043392807 learned_addr learned my addr 172.21.15.43:0/4043392807 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d208e1700 1 -- 172.21.15.43:0/4043392807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c19eb20 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d208e1700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d10006af0 tx=0x7f3d10011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10003b90 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3d10003d30 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c19edb0 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d100197c0 con 0x7f3d1c07de00 2024-04-25T20:38:29.425 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.607+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c19f210 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.608+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f3d10022020 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.608+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1c0640a0 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.608+0000 7f3d19ffb700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 0x7f3d0c03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.608+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3d1004d650 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.608+0000 7f3d1bfff700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 0x7f3d0c03bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.609+0000 7f3d1bfff700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 0x7f3d0c03bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006fd0 tx=0x7f3d08006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.614+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d1004d3b0 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.823+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3d1c1a1c30 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.824+0000 7f3d19ffb700 1 -- 172.21.15.43:0/4043392807 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f3d1c1a1c30 con 0x7f3d1c07de00 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 msgr2=0x7f3d0c03bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 0x7f3d0c03bae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006fd0 tx=0x7f3d08006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 msgr2=0x7f3d1c19e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:29.426 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d10006af0 tx=0x7f3d10011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 shutdown_connections 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f3d0c039620 0x7f3d0c03bae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 --2- 172.21.15.43:0/4043392807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1c07de00 0x7f3d1c19e5e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 >> 172.21.15.43:0/4043392807 conn(0x7f3d1c103cb0 msgr2=0x7f3d1c104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 shutdown_connections 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:28.826+0000 7f3d22b45700 1 -- 172.21.15.43:0/4043392807 wait complete. 2024-04-25T20:38:29.427 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling cephadm module... 2024-04-25T20:38:30.485 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2260023365' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T20:38:30.485 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setuser ceph since I am not root 2024-04-25T20:38:30.485 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setgroup ceph since I am not root 2024-04-25T20:38:30.485 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:30.345+0000 7ff35328f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:38:30.777 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:30.538+0000 7ff35328f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:38:30.777 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:30.644+0000 7ff35328f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.845+0000 7ff2f4180700 1 Processor -- start 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.845+0000 7ff2f4180700 1 -- start start 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.845+0000 7ff2f4180700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.845+0000 7ff2f4180700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec107e90 con 0x7ff2ec1074a0 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f1f1c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:30.785 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f1f1c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52464/0 (socket says 172.21.15.43:52464) 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f1f1c700 1 -- 172.21.15.43:0/3179064641 learned_addr learned my addr 172.21.15.43:0/3179064641 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f1f1c700 1 -- 172.21.15.43:0/3179064641 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1086a0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f1f1c700 1 --2- 172.21.15.43:0/3179064641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d180 tx=0x7ff2e800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaf20459226480f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f0f1a700 1 -- 172.21.15.43:0/3179064641 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8019070 con 0x7ff2ec1074a0 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f0f1a700 1 -- 172.21.15.43:0/3179064641 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ff2e800de20 con 0x7ff2ec1074a0 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.846+0000 7ff2f0f1a700 1 -- 172.21.15.43:0/3179064641 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8009b50 con 0x7ff2ec1074a0 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- 172.21.15.43:0/3179064641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 msgr2=0x7ff2ec1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 --2- 172.21.15.43:0/3179064641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d180 tx=0x7ff2e800d490 comp rx=0 tx=0).stop 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- 172.21.15.43:0/3179064641 shutdown_connections 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 --2- 172.21.15.43:0/3179064641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec1078c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- 172.21.15.43:0/3179064641 >> 172.21.15.43:0/3179064641 conn(0x7ff2ec102a40 msgr2=0x7ff2ec104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- 172.21.15.43:0/3179064641 shutdown_connections 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- 172.21.15.43:0/3179064641 wait complete. 2024-04-25T20:38:30.786 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 Processor -- start 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.847+0000 7ff2f4180700 1 -- start start 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f4180700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f4180700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec07afc0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f1f1c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f1f1c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52472/0 (socket says 172.21.15.43:52472) 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f1f1c700 1 -- 172.21.15.43:0/2260023365 learned_addr learned my addr 172.21.15.43:0/2260023365 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f1f1c700 1 -- 172.21.15.43:0/2260023365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec19a7c0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f1f1c700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d150 tx=0x7ff2e800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8023020 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ff2e801a040 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8019070 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec19aa50 con 0x7ff2ec1074a0 2024-04-25T20:38:30.787 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.848+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec19d740 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.849+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7ff2e8026020 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.849+0000 7ff2e2ffd700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 0x7ff2d803bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.849+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec0640a0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.849+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff2e8011050 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.850+0000 7ff2f171b700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 0x7ff2d803bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.850+0000 7ff2f171b700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 0x7ff2d803bae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc006fd0 tx=0x7ff2dc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:29.855+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff2e802d020 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.123+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff2ec1937e0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.174+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff2ec1937e0 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.176+0000 7ff2e2ffd700 1 -- 172.21.15.43:0/2260023365 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7ff2e801f420 con 0x7ff2ec1074a0 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 msgr2=0x7ff2d803bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 0x7ff2d803bae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc006fd0 tx=0x7ff2dc006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 msgr2=0x7ff2ec19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d150 tx=0x7ff2e800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:38:30.788 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 shutdown_connections 2024-04-25T20:38:30.789 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7ff2d8039620 0x7ff2d803bae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:30.789 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 --2- 172.21.15.43:0/2260023365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2ec1074a0 0x7ff2ec19a280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:30.789 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 >> 172.21.15.43:0/2260023365 conn(0x7ff2ec102a40 msgr2=0x7ff2ec1908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:30.789 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 shutdown_connections 2024-04-25T20:38:30.789 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:30.177+0000 7ff2f4180700 1 -- 172.21.15.43:0/2260023365 wait complete. 2024-04-25T20:38:31.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:30.978+0000 7ff35328f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:38:31.481 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:31 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:31.067+0000 7ff35328f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:38:31.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:31 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2260023365' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T20:38:31.481 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:31 smithi043 ceph-mon[29167]: mgrmap e5: x(active, since 6s) 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e7e22700 1 Processor -- start 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e7e22700 1 -- start start 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e7e22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e7e22700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27e007be60 con 0x7f27e01090c0 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e5bbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:32.158 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e5bbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52488/0 (socket says 172.21.15.43:52488) 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.273+0000 7f27e5bbe700 1 -- 172.21.15.43:0/2055365970 learned_addr learned my addr 172.21.15.43:0/2055365970 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.274+0000 7f27e5bbe700 1 -- 172.21.15.43:0/2055365970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e010b9f0 con 0x7f27e01090c0 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.274+0000 7f27e5bbe700 1 --2- 172.21.15.43:0/2055365970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098a0 tx=0x7f27d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3de3a3816385b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.274+0000 7f27e4bbc700 1 -- 172.21.15.43:0/2055365970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0004160 con 0x7f27e01090c0 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.274+0000 7f27e4bbc700 1 -- 172.21.15.43:0/2055365970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f27d0004300 con 0x7f27e01090c0 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.274+0000 7f27e4bbc700 1 -- 172.21.15.43:0/2055365970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0011b20 con 0x7f27e01090c0 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 -- 172.21.15.43:0/2055365970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 msgr2=0x7f27e010b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 --2- 172.21.15.43:0/2055365970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098a0 tx=0x7f27d0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 -- 172.21.15.43:0/2055365970 shutdown_connections 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 --2- 172.21.15.43:0/2055365970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e010b4b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 -- 172.21.15.43:0/2055365970 >> 172.21.15.43:0/2055365970 conn(0x7f27e0102ad0 msgr2=0x7f27e0104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 -- 172.21.15.43:0/2055365970 shutdown_connections 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.275+0000 7f27e7e22700 1 -- 172.21.15.43:0/2055365970 wait complete. 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e7e22700 1 Processor -- start 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e7e22700 1 -- start start 2024-04-25T20:38:32.159 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e7e22700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e7e22700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f27e010c9a0 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e5bbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e5bbe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52500/0 (socket says 172.21.15.43:52500) 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e5bbe700 1 -- 172.21.15.43:0/3128722766 learned_addr learned my addr 172.21.15.43:0/3128722766 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.276+0000 7f27e5bbe700 1 -- 172.21.15.43:0/3128722766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e019c930 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27e5bbe700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006af0 tx=0x7f27d0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d00039a0 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f27d0003b40 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e019cbc0 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e019d020 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.277+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0019670 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f27d00199b0 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c4005360 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27d6ffd700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 0x7f27cc03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27d004db80 con 0x7f27e01090c0 2024-04-25T20:38:32.160 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27e53bd700 1 -- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 msgr2=0x7f27cc03bae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.278+0000 7f27e53bd700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 0x7f27cc03bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.283+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f27d0011e20 con 0x7f27e01090c0 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.479+0000 7f27e53bd700 1 -- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 msgr2=0x7f27cc03bae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.479+0000 7f27e53bd700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 0x7f27cc03bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.598+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f27c4005e60 con 0x7f27e01090c0 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.598+0000 7f27d6ffd700 1 -- 172.21.15.43:0/3128722766 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f27d0019da0 con 0x7f27e01090c0 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 msgr2=0x7f27cc03bae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 0x7f27cc03bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 msgr2=0x7f27e019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006af0 tx=0x7f27d0011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 shutdown_connections 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f27cc039620 0x7f27cc03bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 --2- 172.21.15.43:0/3128722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27e01090c0 0x7f27e019c3f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.600+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 >> 172.21.15.43:0/3128722766 conn(0x7f27e0102ad0 msgr2=0x7f27e01034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.601+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 shutdown_connections 2024-04-25T20:38:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:31.601+0000 7f27e7e22700 1 -- 172.21.15.43:0/3128722766 wait complete. 2024-04-25T20:38:32.162 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-04-25T20:38:32.162 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 5... 2024-04-25T20:38:32.511 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:32 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3128722766' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T20:38:32.511 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:32 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:32.332+0000 7ff35328f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:38:32.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:32 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:32.511+0000 7ff35328f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:38:32.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:32 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:32.690+0000 7ff35328f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:38:33.087 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:32 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:32.990+0000 7ff35328f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:38:33.087 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:33 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:33.085+0000 7ff35328f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:38:33.497 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:33 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:33.295+0000 7ff35328f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:38:33.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:33 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:33.496+0000 7ff35328f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:38:34.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:34 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:34.119+0000 7ff35328f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:38:34.866 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:34 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:34.556+0000 7ff35328f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:38:34.866 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:34 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:34.656+0000 7ff35328f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:38:34.866 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:34 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:34.865+0000 7ff35328f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:38:35.756 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:35 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:35.407+0000 7ff35328f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:38:35.756 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:35 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:35.503+0000 7ff35328f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:38:36.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:35 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:35.755+0000 7ff35328f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:38:36.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:35 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:35.893+0000 7ff35328f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:38:36.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:35 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:35.991+0000 7ff35328f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:38:36.422 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:36 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:36.110+0000 7ff35328f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:38:36.422 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:36 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:36.421+0000 7ff35328f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:38:37.323 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:37.047+0000 7ff35328f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:38:37.324 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:37.270+0000 7ff35328f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:38:37.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: Active manager daemon x restarted 2024-04-25T20:38:37.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: Activating manager daemon x 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: mgrmap e6: x(active, starting, since 0.00331753s) 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: Manager daemon x is now available 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:38:37.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:37 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:38:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:38 smithi043 ceph-mon[29167]: Found migration_current of "None". Setting to last migration. 2024-04-25T20:38:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:38 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:38:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:38 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:38 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:38 smithi043 ceph-mon[29167]: mgrmap e7: x(active, since 1.00542s) 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.615+0000 7f56b1f09700 1 Processor -- start 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.615+0000 7f56b1f09700 1 -- start start 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56b1f09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56b1f09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac07be60 con 0x7f56ac1090c0 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:38.817 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52502/0 (socket says 172.21.15.43:52502) 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56ab7fe700 1 -- 172.21.15.43:0/4045927383 learned_addr learned my addr 172.21.15.43:0/4045927383 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56ab7fe700 1 -- 172.21.15.43:0/4045927383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac10b9f0 con 0x7f56ac1090c0 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56ab7fe700 1 --2- 172.21.15.43:0/4045927383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098a0 tx=0x7f569c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8942025c744c5c93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.616+0000 7f56aa7fc700 1 -- 172.21.15.43:0/4045927383 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569c004160 con 0x7f56ac1090c0 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56aa7fc700 1 -- 172.21.15.43:0/4045927383 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f569c004300 con 0x7f56ac1090c0 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56aa7fc700 1 -- 172.21.15.43:0/4045927383 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569c011b20 con 0x7f56ac1090c0 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 -- 172.21.15.43:0/4045927383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 msgr2=0x7f56ac10b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 --2- 172.21.15.43:0/4045927383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098a0 tx=0x7f569c009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 -- 172.21.15.43:0/4045927383 shutdown_connections 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 --2- 172.21.15.43:0/4045927383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac10b4b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 -- 172.21.15.43:0/4045927383 >> 172.21.15.43:0/4045927383 conn(0x7f56ac102ad0 msgr2=0x7f56ac104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 -- 172.21.15.43:0/4045927383 shutdown_connections 2024-04-25T20:38:38.818 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.617+0000 7f56b1f09700 1 -- 172.21.15.43:0/4045927383 wait complete. 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56b1f09700 1 Processor -- start 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56b1f09700 1 -- start start 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56b1f09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56b1f09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10c9a0 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52504/0 (socket says 172.21.15.43:52504) 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.618+0000 7f56ab7fe700 1 -- 172.21.15.43:0/3693108053 learned_addr learned my addr 172.21.15.43:0/3693108053 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56ab7fe700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac19c930 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56ab7fe700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f569c0117e0 tx=0x7f569c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569c003b30 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f569c003cd0 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac19cbc0 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569c01a7c0 con 0x7f56ac1090c0 2024-04-25T20:38:38.819 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.619+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac19d020 con 0x7f56ac1090c0 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f569c01a960 con 0x7f56ac1090c0 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56a8ff9700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f56ac0640a0 con 0x7f56940396c0 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f569c04e990 con 0x7f56ac1090c0 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56aaffd700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.620+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.821+0000 7f56aaffd700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:32.821+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:33.222+0000 7f56aaffd700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:33.222+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:34.024+0000 7f56aaffd700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:34.024+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:35.625+0000 7f56aaffd700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/2222849100 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:35.625+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T20:38:38.820 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:37.273+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f569c02d910 con 0x7f56ac1090c0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:37.274+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 msgr2=0x7f569403bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:37.274+0000 7f56a8ff9700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.274+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f569c01ac50 con 0x7f56ac1090c0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.275+0000 7f56a8ff9700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 0x7f569403f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.275+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f569c0068a0 con 0x7f569403cdc0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.275+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 0x7f569403f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.276+0000 7f56aaffd700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 0x7f569403f1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f56a0003a10 tx=0x7f56a00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.276+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f569c0068a0 con 0x7f569403cdc0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f56ac103bc0 con 0x7f569403cdc0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56a8ff9700 1 -- 172.21.15.43:0/3693108053 <== mgr.14120 v2:172.21.15.43:6800/1388340659 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f56ac103bc0 con 0x7f569403cdc0 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 msgr2=0x7f569403f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 0x7f569403f1b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f56a0003a10 tx=0x7f56a00092b0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 msgr2=0x7f56ac19c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:38.821 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f569c0117e0 tx=0x7f569c011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 shutdown_connections 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f569403cdc0 0x7f569403f1b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56ac1090c0 0x7f56ac19c3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 --2- 172.21.15.43:0/3693108053 >> [v2:172.21.15.43:6800/2222849100,v1:172.21.15.43:6801/2222849100] conn(0x7f56940396c0 0x7f569403bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 >> 172.21.15.43:0/3693108053 conn(0x7f56ac102ad0 msgr2=0x7f56ac1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 shutdown_connections 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:38.288+0000 7f56b1f09700 1 -- 172.21.15.43:0/3693108053 wait complete. 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 5 is available 2024-04-25T20:38:38.822 INFO:teuthology.orchestra.run.smithi043.stdout:Setting orchestrator backend to cephadm... 2024-04-25T20:38:39.455 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: [25/Apr/2024:20:38:38] ENGINE Bus STARTING 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: [25/Apr/2024:20:38:38] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: [25/Apr/2024:20:38:38] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: [25/Apr/2024:20:38:38] ENGINE Bus STARTED 2024-04-25T20:38:39.456 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:39 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b344fd700 1 Processor -- start 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b344fd700 1 -- start start 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b344fd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b344fd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c109040 con 0x7f4b2c108650 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b32299700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b32299700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60752/0 (socket says 172.21.15.43:60752) 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b32299700 1 -- 172.21.15.43:0/4291020469 learned_addr learned my addr 172.21.15.43:0/4291020469 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.220+0000 7f4b32299700 1 -- 172.21.15.43:0/4291020469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c109800 con 0x7f4b2c108650 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b32299700 1 --2- 172.21.15.43:0/4291020469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b280098a0 tx=0x7f4b28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f75af13f09d925b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:39.995 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b31297700 1 -- 172.21.15.43:0/4291020469 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b28004160 con 0x7f4b2c108650 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b31297700 1 -- 172.21.15.43:0/4291020469 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4b28004300 con 0x7f4b2c108650 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b31297700 1 -- 172.21.15.43:0/4291020469 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b28011b20 con 0x7f4b2c108650 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 -- 172.21.15.43:0/4291020469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 msgr2=0x7f4b2c108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 --2- 172.21.15.43:0/4291020469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4b280098a0 tx=0x7f4b28009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 -- 172.21.15.43:0/4291020469 shutdown_connections 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 --2- 172.21.15.43:0/4291020469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c108a70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 -- 172.21.15.43:0/4291020469 >> 172.21.15.43:0/4291020469 conn(0x7f4b2c103cb0 msgr2=0x7f4b2c1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.221+0000 7f4b344fd700 1 -- 172.21.15.43:0/4291020469 shutdown_connections 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b344fd700 1 -- 172.21.15.43:0/4291020469 wait complete. 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b344fd700 1 Processor -- start 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b344fd700 1 -- start start 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b344fd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b344fd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c10cbb0 con 0x7f4b2c108650 2024-04-25T20:38:39.996 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b32299700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b32299700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60760/0 (socket says 172.21.15.43:60760) 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.222+0000 7f4b32299700 1 -- 172.21.15.43:0/2103213301 learned_addr learned my addr 172.21.15.43:0/2103213301 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b32299700 1 -- 172.21.15.43:0/2103213301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c19c960 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b32299700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b28006af0 tx=0x7f4b28011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b28003b90 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4b28003d30 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c19cbf0 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b280197c0 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.223+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c19d050 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.224+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f4b28022020 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.224+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c0640a0 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.224+0000 7f4b237fe700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 0x7f4b1803ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.224+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b2804d8a0 con 0x7f4b2c108650 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.224+0000 7f4b31a98700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 0x7f4b1803ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:39.997 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.225+0000 7f4b31a98700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 0x7f4b1803ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006fd0 tx=0x7f4b1c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.230+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b2802bd90 con 0x7f4b2c108650 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.328+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f4b2802c720 con 0x7f4b2c108650 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.455+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f4b2c104dc0 con 0x7f4b180395a0 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.459+0000 7f4b237fe700 1 -- 172.21.15.43:0/2103213301 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4b2c104dc0 con 0x7f4b180395a0 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 msgr2=0x7f4b1803ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 0x7f4b1803ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006fd0 tx=0x7f4b1c006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 msgr2=0x7f4b2c19c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b28006af0 tx=0x7f4b28011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 shutdown_connections 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f4b180395a0 0x7f4b1803ba60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 --2- 172.21.15.43:0/2103213301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b2c108650 0x7f4b2c19c420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 >> 172.21.15.43:0/2103213301 conn(0x7f4b2c103cb0 msgr2=0x7f4b2c1046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 shutdown_connections 2024-04-25T20:38:39.998 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:39.462+0000 7f4b344fd700 1 -- 172.21.15.43:0/2103213301 wait complete. 2024-04-25T20:38:40.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:40 smithi043 ceph-mon[29167]: mgrmap e8: x(active, since 2s) 2024-04-25T20:38:40.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:40 smithi043 ceph-mon[29167]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:40.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:40 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:40.373 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:40 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:38:41.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T20:38:41.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.402+0000 7fd9c9ef5700 1 Processor -- start 2024-04-25T20:38:41.176 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.402+0000 7fd9c9ef5700 1 -- start start 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c9ef5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c9ef5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c407bea0 con 0x7fd9c41090b0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60766/0 (socket says 172.21.15.43:60766) 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c37fe700 1 -- 172.21.15.43:0/781849560 learned_addr learned my addr 172.21.15.43:0/781849560 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c37fe700 1 -- 172.21.15.43:0/781849560 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c410b9e0 con 0x7fd9c41090b0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c37fe700 1 --2- 172.21.15.43:0/781849560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40098a0 tx=0x7fd9b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea61f36fe00eb3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c27fc700 1 -- 172.21.15.43:0/781849560 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4004160 con 0x7fd9c41090b0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.403+0000 7fd9c27fc700 1 -- 172.21.15.43:0/781849560 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd9b4004300 con 0x7fd9c41090b0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c27fc700 1 -- 172.21.15.43:0/781849560 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4011b20 con 0x7fd9c41090b0 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/781849560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 msgr2=0x7fd9c410b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/781849560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40098a0 tx=0x7fd9b4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/781849560 shutdown_connections 2024-04-25T20:38:41.177 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/781849560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c410b4a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/781849560 >> 172.21.15.43:0/781849560 conn(0x7fd9c4102ae0 msgr2=0x7fd9c4104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/781849560 shutdown_connections 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.404+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/781849560 wait complete. 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c9ef5700 1 Processor -- start 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c9ef5700 1 -- start start 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c9ef5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c9ef5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c410c9a0 con 0x7fd9c41090b0 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60768/0 (socket says 172.21.15.43:60768) 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c37fe700 1 -- 172.21.15.43:0/3060226481 learned_addr learned my addr 172.21.15.43:0/3060226481 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.405+0000 7fd9c37fe700 1 -- 172.21.15.43:0/3060226481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c419c910 con 0x7fd9c41090b0 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c37fe700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006af0 tx=0x7fd9b4011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:41.178 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b40039a0 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd9b4003b40 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c419cba0 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4019670 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.406+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c419d000 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fd9b40198e0 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c40640a0 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c0ff9700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 0x7fd9ac03bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd9b404db70 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c2ffd700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 0x7fd9ac03bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.407+0000 7fd9c2ffd700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 0x7fd9ac03bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8006fd0 tx=0x7fd9b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.412+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd9b4011e20 con 0x7fd9c41090b0 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.621+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd9c4103bf0 con 0x7fd9ac039670 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.622+0000 7fd9c0ff9700 1 -- 172.21.15.43:0/3060226481 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd9c4103bf0 con 0x7fd9ac039670 2024-04-25T20:38:41.179 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 msgr2=0x7fd9ac03bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 0x7fd9ac03bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8006fd0 tx=0x7fd9b8006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 msgr2=0x7fd9c419c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006af0 tx=0x7fd9b4011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 shutdown_connections 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fd9ac039670 0x7fd9ac03bb30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 --2- 172.21.15.43:0/3060226481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9c41090b0 0x7fd9c419c3d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 >> 172.21.15.43:0/3060226481 conn(0x7fd9c4102ae0 msgr2=0x7fd9c41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 shutdown_connections 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:40.624+0000 7fd9c9ef5700 1 -- 172.21.15.43:0/3060226481 wait complete. 2024-04-25T20:38:41.180 INFO:teuthology.orchestra.run.smithi043.stdout:Generating ssh key... 2024-04-25T20:38:41.448 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:41 smithi043 ceph-mon[29167]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:42.458 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: Generating public/private rsa key pair. 2024-04-25T20:38:42.458 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: Your identification has been saved in /tmp/tmpeey4b3ao/key. 2024-04-25T20:38:42.458 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: Your public key has been saved in /tmp/tmpeey4b3ao/key.pub. 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: The key fingerprint is: 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: SHA256:P1u1PwpEigRvQ4NMw1VbpGpgyNtfmzXVhjtzUWYDark ceph-92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: The key's randomart image is: 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: +---[RSA 3072]----+ 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | ++o+...o ...+| 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | . .+= . + o ooo| 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | o o = o = o + | 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | + + + + o o .| 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | . . +So E +.. | 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | o ..= ..+. | 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | . oo.. . | 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | +. o | 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: | . .. o| 2024-04-25T20:38:42.459 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: +----[SHA256]-----+ 2024-04-25T20:38:42.724 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f2238d20700 1 Processor -- start 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f2238d20700 1 -- start start 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f2238d20700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f2238d20700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2234109040 con 0x7f2234108650 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f223259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f223259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60770/0 (socket says 172.21.15.43:60770) 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f223259c700 1 -- 172.21.15.43:0/3640745816 learned_addr learned my addr 172.21.15.43:0/3640745816 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.637+0000 7f223259c700 1 -- 172.21.15.43:0/3640745816 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2234109800 con 0x7f2234108650 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f223259c700 1 --2- 172.21.15.43:0/3640745816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f221c0098a0 tx=0x7f221c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e4bfc0ee41a472 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f223159a700 1 -- 172.21.15.43:0/3640745816 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c004160 con 0x7f2234108650 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f223159a700 1 -- 172.21.15.43:0/3640745816 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f221c004300 con 0x7f2234108650 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f223159a700 1 -- 172.21.15.43:0/3640745816 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c011b20 con 0x7f2234108650 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f2238d20700 1 -- 172.21.15.43:0/3640745816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 msgr2=0x7f2234108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.638+0000 7f2238d20700 1 --2- 172.21.15.43:0/3640745816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f221c0098a0 tx=0x7f221c009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 -- 172.21.15.43:0/3640745816 shutdown_connections 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 --2- 172.21.15.43:0/3640745816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f2234108a70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 -- 172.21.15.43:0/3640745816 >> 172.21.15.43:0/3640745816 conn(0x7f2234103cb0 msgr2=0x7f22341060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 -- 172.21.15.43:0/3640745816 shutdown_connections 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 -- 172.21.15.43:0/3640745816 wait complete. 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 Processor -- start 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.639+0000 7f2238d20700 1 -- start start 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f2238d20700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f2238d20700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f223410cbb0 con 0x7f2234108650 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f223259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f223259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60784/0 (socket says 172.21.15.43:60784) 2024-04-25T20:38:42.726 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f223259c700 1 -- 172.21.15.43:0/1395422308 learned_addr learned my addr 172.21.15.43:0/1395422308 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f223259c700 1 -- 172.21.15.43:0/1395422308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f223419c960 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f223259c700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f221c006af0 tx=0x7f221c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c003930 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f221c003ad0 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223419cbf0 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c019610 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.640+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223419d050 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.641+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f221c019880 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.641+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22340640a0 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.642+0000 7f222b7fe700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 0x7f222003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.642+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f221c04dc70 con 0x7f2234108650 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.642+0000 7f2231d9b700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 0x7f222003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:42.727 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.642+0000 7f2231d9b700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 0x7f222003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2224006fd0 tx=0x7f2224006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.647+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f221c011e20 con 0x7f2234108650 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:41.856+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2234104dc0 con 0x7f2220039670 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.119+0000 7f222b7fe700 1 -- 172.21.15.43:0/1395422308 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2234104dc0 con 0x7f2220039670 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.121+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 msgr2=0x7f222003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.121+0000 7f2238d20700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 0x7f222003bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2224006fd0 tx=0x7f2224006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.121+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 msgr2=0x7f223419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.121+0000 7f2238d20700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f221c006af0 tx=0x7f221c011c10 comp rx=0 tx=0).stop 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 shutdown_connections 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f2220039670 0x7f222003bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 --2- 172.21.15.43:0/1395422308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2234108650 0x7f223419c420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 >> 172.21.15.43:0/1395422308 conn(0x7f2234103cb0 msgr2=0x7f22341046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 shutdown_connections 2024-04-25T20:38:42.728 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:42.122+0000 7f2238d20700 1 -- 172.21.15.43:0/1395422308 wait complete. 2024-04-25T20:38:43.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:43 smithi043 ceph-mon[29167]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:43.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:43 smithi043 ceph-mon[29167]: Generating ssh key... 2024-04-25T20:38:43.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:43 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:43.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:43 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.146+0000 7fb007e50700 1 Processor -- start 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb007e50700 1 -- start start 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb007e50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb007e50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb00007c810 con 0x7fb00007de20 2024-04-25T20:38:43.896 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb005bec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb005bec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60790/0 (socket says 172.21.15.43:60790) 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.147+0000 7fb005bec700 1 -- 172.21.15.43:0/3671887444 learned_addr learned my addr 172.21.15.43:0/3671887444 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb005bec700 1 -- 172.21.15.43:0/3671887444 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00007c990 con 0x7fb00007de20 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb005bec700 1 --2- 172.21.15.43:0/3671887444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff40098a0 tx=0x7faff4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b96309bd44c4c3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb004bea700 1 -- 172.21.15.43:0/3671887444 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4004160 con 0x7fb00007de20 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb004bea700 1 -- 172.21.15.43:0/3671887444 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7faff4004300 con 0x7fb00007de20 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb004bea700 1 -- 172.21.15.43:0/3671887444 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4011b20 con 0x7fb00007de20 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb007e50700 1 -- 172.21.15.43:0/3671887444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 msgr2=0x7fb00007c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.148+0000 7fb007e50700 1 --2- 172.21.15.43:0/3671887444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faff40098a0 tx=0x7faff4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- 172.21.15.43:0/3671887444 shutdown_connections 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 --2- 172.21.15.43:0/3671887444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00007c2d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- 172.21.15.43:0/3671887444 >> 172.21.15.43:0/3671887444 conn(0x7fb000103cb0 msgr2=0x7fb0001060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- 172.21.15.43:0/3671887444 shutdown_connections 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- 172.21.15.43:0/3671887444 wait complete. 2024-04-25T20:38:43.897 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 Processor -- start 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- start start 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.149+0000 7fb007e50700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb00010eb60 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb005bec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb005bec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60804/0 (socket says 172.21.15.43:60804) 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb005bec700 1 -- 172.21.15.43:0/4028375422 learned_addr learned my addr 172.21.15.43:0/4028375422 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb005bec700 1 -- 172.21.15.43:0/4028375422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00019eb30 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb005bec700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faff40116a0 tx=0x7faff4011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4003ab0 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7faff4003c50 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00019edc0 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00019f220 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.150+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4019870 con 0x7fb00007de20 2024-04-25T20:38:43.898 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.151+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7faff4019b30 con 0x7fb00007de20 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.151+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0000640a0 con 0x7fb00007de20 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.151+0000 7faff2ffd700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 0x7fafec03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.151+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faff404dad0 con 0x7fb00007de20 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.152+0000 7fb0053eb700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 0x7fafec03bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.152+0000 7fb0053eb700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 0x7fafec03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faffc006fd0 tx=0x7faffc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.157+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faff4011e20 con 0x7fb00007de20 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.369+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb000104dc0 con 0x7fafec039620 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.369+0000 7faff2ffd700 1 -- 172.21.15.43:0/4028375422 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb000104dc0 con 0x7fafec039620 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 msgr2=0x7fafec03bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 0x7fafec03bae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faffc006fd0 tx=0x7faffc006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 msgr2=0x7fb00019e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faff40116a0 tx=0x7faff4011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:43.899 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 shutdown_connections 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fafec039620 0x7fafec03bae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 --2- 172.21.15.43:0/4028375422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb00007de20 0x7fb00019e5f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 >> 172.21.15.43:0/4028375422 conn(0x7fb000103cb0 msgr2=0x7fb0001046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.371+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 shutdown_connections 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:43.372+0000 7fb007e50700 1 -- 172.21.15.43:0/4028375422 wait complete. 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T20:38:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:Adding host smithi043... 2024-04-25T20:38:44.534 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:44 smithi043 ceph-mon[29167]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:45.438 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:45 smithi043 ceph-mon[29167]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:45.438 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:45 smithi043 ceph-mon[29167]: Deploying cephadm binary to smithi043 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Added host 'smithi043' with addr '172.21.15.43' 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cfbf8f700 1 Processor -- start 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cfbf8f700 1 -- start start 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cfbf8f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cfbf8f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf407c810 con 0x7f9cf407de20 2024-04-25T20:38:49.337 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cf9d2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cf9d2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60818/0 (socket says 172.21.15.43:60818) 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.306+0000 7f9cf9d2b700 1 -- 172.21.15.43:0/822100454 learned_addr learned my addr 172.21.15.43:0/822100454 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.307+0000 7f9cf9d2b700 1 -- 172.21.15.43:0/822100454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf407c990 con 0x7f9cf407de20 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.307+0000 7f9cf9d2b700 1 --2- 172.21.15.43:0/822100454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098a0 tx=0x7f9cf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c39968fc0b2ab3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.307+0000 7f9cf8d29700 1 -- 172.21.15.43:0/822100454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0004160 con 0x7f9cf407de20 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.307+0000 7f9cf8d29700 1 -- 172.21.15.43:0/822100454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9cf0004300 con 0x7f9cf407de20 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.307+0000 7f9cf8d29700 1 -- 172.21.15.43:0/822100454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0011b20 con 0x7f9cf407de20 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/822100454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 msgr2=0x7f9cf407c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/822100454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098a0 tx=0x7f9cf0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/822100454 shutdown_connections 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/822100454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf407c2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/822100454 >> 172.21.15.43:0/822100454 conn(0x7f9cf4103cb0 msgr2=0x7f9cf41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/822100454 shutdown_connections 2024-04-25T20:38:49.338 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/822100454 wait complete. 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 Processor -- start 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.308+0000 7f9cfbf8f700 1 -- start start 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cfbf8f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cfbf8f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf410eb60 con 0x7f9cf407de20 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cf9d2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cf9d2b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60828/0 (socket says 172.21.15.43:60828) 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cf9d2b700 1 -- 172.21.15.43:0/3480867398 learned_addr learned my addr 172.21.15.43:0/3480867398 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cf9d2b700 1 -- 172.21.15.43:0/3480867398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf419eb30 con 0x7f9cf407de20 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cf9d2b700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00116a0 tx=0x7f9cf0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0003ab0 con 0x7f9cf407de20 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9cf0003c50 con 0x7f9cf407de20 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf419edc0 con 0x7f9cf407de20 2024-04-25T20:38:49.339 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0019870 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.309+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf419f220 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.310+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f9cf001ac00 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.310+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf40640a0 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.311+0000 7f9ceaffd700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 0x7f9ce003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.311+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9cf004dac0 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.311+0000 7f9cf952a700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 0x7f9ce003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.311+0000 7f9cf952a700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 0x7f9ce003bb30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4006fd0 tx=0x7f9ce4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.316+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9cf0011e20 con 0x7f9cf407de20 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:44.534+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi043", "addr": "172.21.15.43", "target": ["mon-mgr", ""]}) -- 0x7f9cf4104dc0 con 0x7f9ce0039670 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.754+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3480867398 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f9cf4104dc0 con 0x7f9ce0039670 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 msgr2=0x7f9ce003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 0x7f9ce003bb30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4006fd0 tx=0x7f9ce4006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 msgr2=0x7f9cf419e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00116a0 tx=0x7f9cf0011ce0 comp rx=0 tx=0).stop 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 shutdown_connections 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f9ce0039670 0x7f9ce003bb30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 --2- 172.21.15.43:0/3480867398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf407de20 0x7f9cf419e5f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 >> 172.21.15.43:0/3480867398 conn(0x7f9cf4103cb0 msgr2=0x7f9cf41046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 shutdown_connections 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:48.757+0000 7f9cfbf8f700 1 -- 172.21.15.43:0/3480867398 wait complete. 2024-04-25T20:38:49.341 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mon service... 2024-04-25T20:38:50.010 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:49 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:50.010 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:49 smithi043 ceph-mon[29167]: Added host smithi043 2024-04-25T20:38:50.011 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:49 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:38:51.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:51 smithi043 ceph-mon[29167]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:51.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:51 smithi043 ceph-mon[29167]: Saving service mon spec with placement count:5 2024-04-25T20:38:51.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:51 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:51.586 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T20:38:51.586 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.795+0000 7f88c6a45700 1 Processor -- start 2024-04-25T20:38:51.586 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.795+0000 7f88c6a45700 1 -- start start 2024-04-25T20:38:51.586 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.795+0000 7f88c6a45700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:51.586 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.795+0000 7f88c6a45700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88c0109040 con 0x7f88c0108650 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.795+0000 7f88bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40904/0 (socket says 172.21.15.43:40904) 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88bffff700 1 -- 172.21.15.43:0/2584452426 learned_addr learned my addr 172.21.15.43:0/2584452426 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88bffff700 1 -- 172.21.15.43:0/2584452426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c0109800 con 0x7f88c0108650 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88bffff700 1 --2- 172.21.15.43:0/2584452426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098a0 tx=0x7f88b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cae06fab7f4833 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88beffd700 1 -- 172.21.15.43:0/2584452426 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b0004160 con 0x7f88c0108650 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88beffd700 1 -- 172.21.15.43:0/2584452426 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f88b0004300 con 0x7f88c0108650 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.796+0000 7f88beffd700 1 -- 172.21.15.43:0/2584452426 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b0011b20 con 0x7f88c0108650 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- 172.21.15.43:0/2584452426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 msgr2=0x7f88c0108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 --2- 172.21.15.43:0/2584452426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f88b00098a0 tx=0x7f88b0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- 172.21.15.43:0/2584452426 shutdown_connections 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 --2- 172.21.15.43:0/2584452426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c0108a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- 172.21.15.43:0/2584452426 >> 172.21.15.43:0/2584452426 conn(0x7f88c0103cb0 msgr2=0x7f88c01060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:51.587 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- 172.21.15.43:0/2584452426 shutdown_connections 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- 172.21.15.43:0/2584452426 wait complete. 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 Processor -- start 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.797+0000 7f88c6a45700 1 -- start start 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88c6a45700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88c6a45700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88c010cbb0 con 0x7f88c0108650 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40910/0 (socket says 172.21.15.43:40910) 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bffff700 1 -- 172.21.15.43:0/3246637373 learned_addr learned my addr 172.21.15.43:0/3246637373 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bffff700 1 -- 172.21.15.43:0/3246637373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c019c960 con 0x7f88c0108650 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bffff700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006af0 tx=0x7f88b0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b0003930 con 0x7f88c0108650 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f88b0003ad0 con 0x7f88c0108650 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c019cbf0 con 0x7f88c0108650 2024-04-25T20:38:51.588 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b0019610 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.798+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c019d050 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.799+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f88b001aa00 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.799+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c00640a0 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.799+0000 7f88bd7fa700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 0x7f88a803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.799+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88b004dbc0 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.800+0000 7f88bf7fe700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 0x7f88a803bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.800+0000 7f88bf7fe700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 0x7f88a803bb30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88b4006fd0 tx=0x7f88b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:49.805+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f88b0011e20 con 0x7f88c0108650 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.030+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f88c0104dc0 con 0x7f88a8039670 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.035+0000 7f88bd7fa700 1 -- 172.21.15.43:0/3246637373 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f88c0104dc0 con 0x7f88a8039670 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 msgr2=0x7f88a803bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 0x7f88a803bb30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88b4006fd0 tx=0x7f88b4006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 msgr2=0x7f88c019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:51.589 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006af0 tx=0x7f88b0011c10 comp rx=0 tx=0).stop 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 shutdown_connections 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f88a8039670 0x7f88a803bb30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 --2- 172.21.15.43:0/3246637373 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88c0108650 0x7f88c019c420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 >> 172.21.15.43:0/3246637373 conn(0x7f88c0103cb0 msgr2=0x7f88c01046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 shutdown_connections 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:50.037+0000 7f88c6a45700 1 -- 172.21.15.43:0/3246637373 wait complete. 2024-04-25T20:38:51.590 INFO:teuthology.orchestra.run.smithi043.stdout:Deploying unmanaged mgr service... 2024-04-25T20:38:52.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:52 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.059+0000 7fe690150700 1 Processor -- start 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe690150700 1 -- start start 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe690150700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe690150700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe688109040 con 0x7fe688108650 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe68deec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe68deec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40926/0 (socket says 172.21.15.43:40926) 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe68deec700 1 -- 172.21.15.43:0/3946793295 learned_addr learned my addr 172.21.15.43:0/3946793295 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.060+0000 7fe68deec700 1 -- 172.21.15.43:0/3946793295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe688109800 con 0x7fe688108650 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe68deec700 1 --2- 172.21.15.43:0/3946793295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6840098a0 tx=0x7fe684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a98d494e4f71599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe68ceea700 1 -- 172.21.15.43:0/3946793295 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe684004160 con 0x7fe688108650 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe68ceea700 1 -- 172.21.15.43:0/3946793295 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe684004300 con 0x7fe688108650 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe68ceea700 1 -- 172.21.15.43:0/3946793295 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe684011af0 con 0x7fe688108650 2024-04-25T20:38:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe690150700 1 -- 172.21.15.43:0/3946793295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 msgr2=0x7fe688108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.061+0000 7fe690150700 1 --2- 172.21.15.43:0/3946793295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe6840098a0 tx=0x7fe684009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- 172.21.15.43:0/3946793295 shutdown_connections 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 --2- 172.21.15.43:0/3946793295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe688108a70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- 172.21.15.43:0/3946793295 >> 172.21.15.43:0/3946793295 conn(0x7fe688103cb0 msgr2=0x7fe6881060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- 172.21.15.43:0/3946793295 shutdown_connections 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- 172.21.15.43:0/3946793295 wait complete. 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 Processor -- start 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- start start 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.062+0000 7fe690150700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe68810cbb0 con 0x7fe688108650 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe68deec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe68deec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40932/0 (socket says 172.21.15.43:40932) 2024-04-25T20:38:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe68deec700 1 -- 172.21.15.43:0/3899230996 learned_addr learned my addr 172.21.15.43:0/3899230996 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe68deec700 1 -- 172.21.15.43:0/3899230996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68807e0a0 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe68deec700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe684009520 tx=0x7fe6840045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6840036a0 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68807c290 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe68401a430 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe684019550 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.063+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68807c7d0 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.064+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fe684019850 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.064+0000 7fe67effd700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 0x7fe67403bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.064+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe68404ec00 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.064+0000 7fe68d6eb700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 0x7fe67403bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.064+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6880640a0 con 0x7fe688108650 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.065+0000 7fe68d6eb700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 0x7fe67403bae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe678006fd0 tx=0x7fe678006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.069+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe684020240 con 0x7fe688108650 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.330+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe68807d100 con 0x7fe674039620 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.334+0000 7fe67effd700 1 -- 172.21.15.43:0/3899230996 <== mgr.14120 v2:172.21.15.43:6800/1388340659 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe68807d100 con 0x7fe674039620 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 msgr2=0x7fe67403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 0x7fe67403bae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe678006fd0 tx=0x7fe678006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 msgr2=0x7fe68807db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe684009520 tx=0x7fe6840045f0 comp rx=0 tx=0).stop 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 shutdown_connections 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fe674039620 0x7fe67403bae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 --2- 172.21.15.43:0/3899230996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe688108650 0x7fe68807db60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 >> 172.21.15.43:0/3899230996 conn(0x7fe688103cb0 msgr2=0x7fe6881046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 shutdown_connections 2024-04-25T20:38:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:52.337+0000 7fe690150700 1 -- 172.21.15.43:0/3899230996 wait complete. 2024-04-25T20:38:53.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:53 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:53.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:53 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:54.384 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:54 smithi043 ceph-mon[29167]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:38:54.384 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:54 smithi043 ceph-mon[29167]: Saving service mgr spec with placement count:2 2024-04-25T20:38:54.384 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:54 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2645590852' entity='client.admin' 2024-04-25T20:38:54.384 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:54 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.318+0000 7f394d6d5700 1 Processor -- start 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.318+0000 7f394d6d5700 1 -- start start 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.318+0000 7f394d6d5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.318+0000 7f394d6d5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3948108fb0 con 0x7f39481085c0 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3946ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3946ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40936/0 (socket says 172.21.15.43:40936) 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3946ffd700 1 -- 172.21.15.43:0/36711544 learned_addr learned my addr 172.21.15.43:0/36711544 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:54.651 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3946ffd700 1 -- 172.21.15.43:0/36711544 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3948109770 con 0x7f39481085c0 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3946ffd700 1 --2- 172.21.15.43:0/36711544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39380098a0 tx=0x7f3938009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8403bafa11f1b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3945ffb700 1 -- 172.21.15.43:0/36711544 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3938004160 con 0x7f39481085c0 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3945ffb700 1 -- 172.21.15.43:0/36711544 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3938004300 con 0x7f39481085c0 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.319+0000 7f3945ffb700 1 -- 172.21.15.43:0/36711544 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3938011af0 con 0x7f39481085c0 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 -- 172.21.15.43:0/36711544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 msgr2=0x7f39481089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 --2- 172.21.15.43:0/36711544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39380098a0 tx=0x7f3938009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 -- 172.21.15.43:0/36711544 shutdown_connections 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 --2- 172.21.15.43:0/36711544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f39481089e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 -- 172.21.15.43:0/36711544 >> 172.21.15.43:0/36711544 conn(0x7f3948103be0 msgr2=0x7f3948106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 -- 172.21.15.43:0/36711544 shutdown_connections 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 -- 172.21.15.43:0/36711544 wait complete. 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.320+0000 7f394d6d5700 1 Processor -- start 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f394d6d5700 1 -- start start 2024-04-25T20:38:54.652 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f394d6d5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f394d6d5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f394810cb20 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f3946ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f3946ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40950/0 (socket says 172.21.15.43:40950) 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f3946ffd700 1 -- 172.21.15.43:0/2645590852 learned_addr learned my addr 172.21.15.43:0/2645590852 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f3946ffd700 1 -- 172.21.15.43:0/2645590852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394819c940 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.321+0000 7f3946ffd700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3938003f90 tx=0x7f3938011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39380039e0 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3938003b80 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394819cbd0 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39380196e0 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394819f8c0 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.322+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3938022020 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.323+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39480640a0 con 0x7f39481085c0 2024-04-25T20:38:54.653 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.323+0000 7f392ffff700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 0x7f393003bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.323+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f393804d830 con 0x7f39481085c0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.323+0000 7f39467fc700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 0x7f393003bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.323+0000 7f39467fc700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 0x7f393003bb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f393c006fd0 tx=0x7f393c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.328+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f393801abf0 con 0x7f39481085c0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.557+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f394819fe90 con 0x7f39481085c0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.559+0000 7f392ffff700 1 -- 172.21.15.43:0/2645590852 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3938019930 con 0x7f39481085c0 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 msgr2=0x7f393003bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 0x7f393003bb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f393c006fd0 tx=0x7f393c006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 msgr2=0x7f394819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3938003f90 tx=0x7f3938011b70 comp rx=0 tx=0).stop 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 shutdown_connections 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f39300396c0 0x7f393003bb80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 --2- 172.21.15.43:0/2645590852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39481085c0 0x7f394819c400 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:54.654 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 >> 172.21.15.43:0/2645590852 conn(0x7f3948103be0 msgr2=0x7f3948104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:54.655 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 shutdown_connections 2024-04-25T20:38:54.655 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:53.562+0000 7f394d6d5700 1 -- 172.21.15.43:0/2645590852 wait complete. 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.144+0000 7ff77c6f5700 1 Processor -- start 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.144+0000 7ff77c6f5700 1 -- start start 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.144+0000 7ff77c6f5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.144+0000 7ff77c6f5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff774109000 con 0x7ff774108610 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.144+0000 7ff77a491700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77a491700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40952/0 (socket says 172.21.15.43:40952) 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77a491700 1 -- 172.21.15.43:0/1357294150 learned_addr learned my addr 172.21.15.43:0/1357294150 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77a491700 1 -- 172.21.15.43:0/1357294150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7741097c0 con 0x7ff774108610 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77a491700 1 --2- 172.21.15.43:0/1357294150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7700098a0 tx=0x7ff770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d79d89fbf4e4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77948f700 1 -- 172.21.15.43:0/1357294150 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff770004160 con 0x7ff774108610 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77948f700 1 -- 172.21.15.43:0/1357294150 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff770004300 con 0x7ff774108610 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.145+0000 7ff77948f700 1 -- 172.21.15.43:0/1357294150 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff770011af0 con 0x7ff774108610 2024-04-25T20:38:55.991 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 -- 172.21.15.43:0/1357294150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 msgr2=0x7ff774108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/1357294150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7700098a0 tx=0x7ff770009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 -- 172.21.15.43:0/1357294150 shutdown_connections 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/1357294150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff774108a30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 -- 172.21.15.43:0/1357294150 >> 172.21.15.43:0/1357294150 conn(0x7ff774103c10 msgr2=0x7ff774106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 -- 172.21.15.43:0/1357294150 shutdown_connections 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.146+0000 7ff77c6f5700 1 -- 172.21.15.43:0/1357294150 wait complete. 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77c6f5700 1 Processor -- start 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77c6f5700 1 -- start start 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77c6f5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77c6f5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff77410cb70 con 0x7ff774108610 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77a491700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77a491700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40966/0 (socket says 172.21.15.43:40966) 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77a491700 1 -- 172.21.15.43:0/2127193852 learned_addr learned my addr 172.21.15.43:0/2127193852 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:55.992 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.147+0000 7ff77a491700 1 -- 172.21.15.43:0/2127193852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77419c930 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff77a491700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff770009520 tx=0x7ff770003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7700036a0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff77001a430 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7700193c0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77419cbc0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.148+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77419f8b0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.149+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff770019560 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.149+0000 7ff76b7fe700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 0x7ff76003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.149+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff77004d790 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.149+0000 7ff779c90700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 0x7ff76003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.149+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7740640a0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.150+0000 7ff779c90700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 0x7ff76003bb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff764006fd0 tx=0x7ff764006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.154+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff77000f2e0 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.363+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7ff77419fa80 con 0x7ff774108610 2024-04-25T20:38:55.993 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.365+0000 7ff76b7fe700 1 -- 172.21.15.43:0/2127193852 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7ff77000b7e0 con 0x7ff774108610 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 msgr2=0x7ff76003bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 0x7ff76003bb30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff764006fd0 tx=0x7ff764006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 msgr2=0x7ff77419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff770009520 tx=0x7ff770003eb0 comp rx=0 tx=0).stop 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 shutdown_connections 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff760039670 0x7ff76003bb30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 --2- 172.21.15.43:0/2127193852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff774108610 0x7ff77419c3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 >> 172.21.15.43:0/2127193852 conn(0x7ff774103c10 msgr2=0x7ff774104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 shutdown_connections 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:55.368+0000 7ff77c6f5700 1 -- 172.21.15.43:0/2127193852 wait complete. 2024-04-25T20:38:55.994 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling the dashboard module... 2024-04-25T20:38:56.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:56 smithi043 ceph-mon[29167]: from='mgr.14120 172.21.15.43:0/685412627' entity='mgr.x' 2024-04-25T20:38:56.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:56 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2127193852' entity='client.admin' 2024-04-25T20:38:57.669 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3538517989' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T20:38:57.670 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setuser ceph since I am not root 2024-04-25T20:38:57.670 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setgroup ceph since I am not root 2024-04-25T20:38:57.670 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:57.548+0000 7fa5f67b8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:38:57.970 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:57.744+0000 7fa5f67b8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:38:57.970 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:57.850+0000 7fa5f67b8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:38:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6ff8c3700 1 Processor -- start 2024-04-25T20:38:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6ff8c3700 1 -- start start 2024-04-25T20:38:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6ff8c3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:57.977 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6ff8c3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8108fb0 con 0x7fb6f81085c0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6fd65f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6fd65f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35760/0 (socket says 172.21.15.43:35760) 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.375+0000 7fb6fd65f700 1 -- 172.21.15.43:0/3689823486 learned_addr learned my addr 172.21.15.43:0/3689823486 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.376+0000 7fb6fd65f700 1 -- 172.21.15.43:0/3689823486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f8109770 con 0x7fb6f81085c0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.376+0000 7fb6fd65f700 1 --2- 172.21.15.43:0/3689823486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098a0 tx=0x7fb6f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743e7c9993d4505a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.376+0000 7fb6effff700 1 -- 172.21.15.43:0/3689823486 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4004160 con 0x7fb6f81085c0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.376+0000 7fb6effff700 1 -- 172.21.15.43:0/3689823486 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6f4004300 con 0x7fb6f81085c0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.376+0000 7fb6effff700 1 -- 172.21.15.43:0/3689823486 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4011af0 con 0x7fb6f81085c0 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3689823486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 msgr2=0x7fb6f81089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3689823486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098a0 tx=0x7fb6f4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3689823486 shutdown_connections 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3689823486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f81089e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:57.978 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3689823486 >> 172.21.15.43:0/3689823486 conn(0x7fb6f8103be0 msgr2=0x7fb6f8106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3689823486 shutdown_connections 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.377+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3689823486 wait complete. 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6ff8c3700 1 Processor -- start 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6ff8c3700 1 -- start start 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6ff8c3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6ff8c3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f810cb20 con 0x7fb6f81085c0 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6fd65f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6fd65f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35762/0 (socket says 172.21.15.43:35762) 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.378+0000 7fb6fd65f700 1 -- 172.21.15.43:0/3538517989 learned_addr learned my addr 172.21.15.43:0/3538517989 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6fd65f700 1 -- 172.21.15.43:0/3538517989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f819c960 con 0x7fb6f81085c0 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6fd65f700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4003f90 tx=0x7fb6f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f40039e0 con 0x7fb6f81085c0 2024-04-25T20:38:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6f4003b80 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f819cbf0 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f40196e0 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.379+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f819f8e0 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.380+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fb6f4022020 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.380+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f80640a0 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.380+0000 7fb6ee7fc700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 0x7fb6e403bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.380+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb6f404d880 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.381+0000 7fb6fce5e700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 0x7fb6e403bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.381+0000 7fb6fce5e700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 0x7fb6e403bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.386+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb6f400e260 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:56.660+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb6f819fe90 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.362+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb6f4020c10 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.364+0000 7fb6ee7fc700 1 -- 172.21.15.43:0/3538517989 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fb6f402c720 con 0x7fb6f81085c0 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 msgr2=0x7fb6e403bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:57.980 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 0x7fb6e403bb30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8006e40 comp rx=0 tx=0).stop 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 msgr2=0x7fb6f819c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4003f90 tx=0x7fb6f4011b70 comp rx=0 tx=0).stop 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 shutdown_connections 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7fb6e4039670 0x7fb6e403bb30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 --2- 172.21.15.43:0/3538517989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f81085c0 0x7fb6f819c420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.366+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 >> 172.21.15.43:0/3538517989 conn(0x7fb6f8103be0 msgr2=0x7fb6f8104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.367+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 shutdown_connections 2024-04-25T20:38:57.981 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:57.367+0000 7fb6ff8c3700 1 -- 172.21.15.43:0/3538517989 wait complete. 2024-04-25T20:38:58.273 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:58.178+0000 7fa5f67b8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:38:58.273 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:58.271+0000 7fa5f67b8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:38:58.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:58 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3538517989' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T20:38:58.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:58 smithi043 ceph-mon[29167]: mgrmap e9: x(active, since 20s) 2024-04-25T20:38:59.351 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.407+0000 7f262bf13700 1 Processor -- start 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.407+0000 7f262bf13700 1 -- start start 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f262bf13700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f262bf13700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2624108380 con 0x7f2624107990 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2629caf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2629caf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35796/0 (socket says 172.21.15.43:35796) 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2629caf700 1 -- 172.21.15.43:0/2482153644 learned_addr learned my addr 172.21.15.43:0/2482153644 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:59.352 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2629caf700 1 -- 172.21.15.43:0/2482153644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26241086b0 con 0x7f2624107990 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2629caf700 1 --2- 172.21.15.43:0/2482153644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26200098a0 tx=0x7f2620009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc5a37591c86d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2628cad700 1 -- 172.21.15.43:0/2482153644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2620004160 con 0x7f2624107990 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.408+0000 7f2628cad700 1 -- 172.21.15.43:0/2482153644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2620004300 con 0x7f2624107990 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f2628cad700 1 -- 172.21.15.43:0/2482153644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2620011af0 con 0x7f2624107990 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 -- 172.21.15.43:0/2482153644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 msgr2=0x7f2624107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 --2- 172.21.15.43:0/2482153644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26200098a0 tx=0x7f2620009bb0 comp rx=0 tx=0).stop 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 -- 172.21.15.43:0/2482153644 shutdown_connections 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 --2- 172.21.15.43:0/2482153644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f2624107db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 -- 172.21.15.43:0/2482153644 >> 172.21.15.43:0/2482153644 conn(0x7f26241021b0 msgr2=0x7f26241045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 -- 172.21.15.43:0/2482153644 shutdown_connections 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.409+0000 7f262bf13700 1 -- 172.21.15.43:0/2482153644 wait complete. 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f262bf13700 1 Processor -- start 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f262bf13700 1 -- start start 2024-04-25T20:38:59.353 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f262bf13700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f262bf13700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f262410ba60 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f2629caf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f2629caf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35802/0 (socket says 172.21.15.43:35802) 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.410+0000 7f2629caf700 1 -- 172.21.15.43:0/1337793297 learned_addr learned my addr 172.21.15.43:0/1337793297 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f2629caf700 1 -- 172.21.15.43:0/1337793297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262419eb90 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f2629caf700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2620003f90 tx=0x7f2620011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26200039e0 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2620003b80 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262419ee20 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26200196e0 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.411+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26241a1ac0 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f2620022020 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26240640a0 con 0x7f2624107990 2024-04-25T20:38:59.354 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f261affd700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 0x7f261003bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f262004da40 con 0x7f2624107990 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f26294ae700 1 -- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 msgr2=0x7f261003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.412+0000 7f26294ae700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 0x7f261003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.417+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f262002c720 con 0x7f2624107990 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.613+0000 7f26294ae700 1 -- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 msgr2=0x7f261003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.613+0000 7f26294ae700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 0x7f261003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.720+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f262402e1d0 con 0x7f2624107990 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.721+0000 7f261affd700 1 -- 172.21.15.43:0/1337793297 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f262004de20 con 0x7f2624107990 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 msgr2=0x7f261003bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 0x7f261003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 msgr2=0x7f262419e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2620003f90 tx=0x7f2620011b70 comp rx=0 tx=0).stop 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 shutdown_connections 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7f26100396c0 0x7f261003bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 --2- 172.21.15.43:0/1337793297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2624107990 0x7f262419e650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:38:59.355 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 >> 172.21.15.43:0/1337793297 conn(0x7f26241021b0 msgr2=0x7f2624102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:38:59.356 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 shutdown_connections 2024-04-25T20:38:59.356 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:58.725+0000 7f262bf13700 1 -- 172.21.15.43:0/1337793297 wait complete. 2024-04-25T20:38:59.356 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for the mgr to restart... 2024-04-25T20:38:59.356 INFO:teuthology.orchestra.run.smithi043.stdout:Waiting for mgr epoch 9... 2024-04-25T20:38:59.594 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:38:59 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1337793297' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T20:38:59.594 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:59.553+0000 7fa5f67b8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:39:00.007 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:59.737+0000 7fa5f67b8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:39:00.007 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:38:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:38:59.917+0000 7fa5f67b8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:39:00.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:00.221+0000 7fa5f67b8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:39:00.733 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:00.318+0000 7fa5f67b8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:39:00.734 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:00.529+0000 7fa5f67b8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:39:01.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:00.733+0000 7fa5f67b8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:39:01.544 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:01.366+0000 7fa5f67b8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:39:02.128 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:01.813+0000 7fa5f67b8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:39:02.128 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:01.914+0000 7fa5f67b8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:39:02.128 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:02.127+0000 7fa5f67b8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:39:03.031 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:02.677+0000 7fa5f67b8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:39:03.031 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:02.774+0000 7fa5f67b8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:39:03.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:03.030+0000 7fa5f67b8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:39:03.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:03.171+0000 7fa5f67b8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:39:03.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:03.271+0000 7fa5f67b8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:39:03.706 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:03.392+0000 7fa5f67b8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:39:03.706 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:03.705+0000 7fa5f67b8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:39:04.624 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:04.342+0000 7fa5f67b8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:39:04.624 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:39:04.571+0000 7fa5f67b8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:39:05.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: Active manager daemon x restarted 2024-04-25T20:39:05.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: Activating manager daemon x 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: mgrmap e10: x(active, starting, since 0.00349373s) 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: Manager daemon x is now available 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:39:05.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:39:05.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:05 smithi043 ceph-mon[29167]: mgrmap e11: x(active, since 1.00613s) 2024-04-25T20:39:06.110 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout { 2024-04-25T20:39:06.110 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T20:39:06.110 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T20:39:06.110 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout } 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff106d3d700 1 Processor -- start 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff106d3d700 1 -- start start 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff106d3d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff106d3d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff10007be80 con 0x7ff100109030 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff104ad9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff104ad9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35818/0 (socket says 172.21.15.43:35818) 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff104ad9700 1 -- 172.21.15.43:0/1338174314 learned_addr learned my addr 172.21.15.43:0/1338174314 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.801+0000 7ff104ad9700 1 -- 172.21.15.43:0/1338174314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10010b960 con 0x7ff100109030 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.802+0000 7ff104ad9700 1 --2- 172.21.15.43:0/1338174314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098a0 tx=0x7ff0f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd18dd938295ea01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.802+0000 7ff0ff7fe700 1 -- 172.21.15.43:0/1338174314 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f4004160 con 0x7ff100109030 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.802+0000 7ff0ff7fe700 1 -- 172.21.15.43:0/1338174314 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff0f4004300 con 0x7ff100109030 2024-04-25T20:39:06.111 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.802+0000 7ff0ff7fe700 1 -- 172.21.15.43:0/1338174314 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f4011af0 con 0x7ff100109030 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 -- 172.21.15.43:0/1338174314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 msgr2=0x7ff10010b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 --2- 172.21.15.43:0/1338174314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40098a0 tx=0x7ff0f4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 -- 172.21.15.43:0/1338174314 shutdown_connections 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 --2- 172.21.15.43:0/1338174314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10010b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 -- 172.21.15.43:0/1338174314 >> 172.21.15.43:0/1338174314 conn(0x7ff100102a40 msgr2=0x7ff100104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 -- 172.21.15.43:0/1338174314 shutdown_connections 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 -- 172.21.15.43:0/1338174314 wait complete. 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.803+0000 7ff106d3d700 1 Processor -- start 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff106d3d700 1 -- start start 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff106d3d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff106d3d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010c960 con 0x7ff100109030 2024-04-25T20:39:06.112 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff104ad9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff104ad9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35830/0 (socket says 172.21.15.43:35830) 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff104ad9700 1 -- 172.21.15.43:0/749488408 learned_addr learned my addr 172.21.15.43:0/749488408 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff104ad9700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10019c900 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff104ad9700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4003f90 tx=0x7ff0f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.804+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f40039e0 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.805+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10019cbf0 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.805+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff0f4003b80 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.805+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f40196e0 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.805+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10019f880 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7ff0f4022020 con 0x7ff100109030 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fdffb700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff0f003c290 con 0x7ff0f00396c0 2024-04-25T20:39:06.113 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff0f404d8c0 con 0x7ff100109030 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fffff700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:38:59.806+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:00.007+0000 7ff0fffff700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:00.007+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:00.408+0000 7ff0fffff700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:00.408+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:01.209+0000 7ff0fffff700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:01.209+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:02.810+0000 7ff0fffff700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/1388340659 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:02.810+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:04.574+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7ff0f4019ce0 con 0x7ff100109030 2024-04-25T20:39:06.114 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:04.574+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 msgr2=0x7ff0f003bb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:04.574+0000 7ff0fdffb700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.576+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7ff0f404f950 con 0x7ff100109030 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.576+0000 7ff0fdffb700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 0x7ff0f003f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.576+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff0f003c290 con 0x7ff0f003cfb0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.576+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 0x7ff0f003f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.577+0000 7ff0fffff700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 0x7ff0f003f3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec003a10 tx=0x7ff0ec0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.578+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff0f003c290 con 0x7ff0f003cfb0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.584+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff1000640a0 con 0x7ff0f003cfb0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff0fdffb700 1 -- 172.21.15.43:0/749488408 <== mgr.14152 v2:172.21.15.43:6800/3531160359 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff1000640a0 con 0x7ff0f003cfb0 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 msgr2=0x7ff0f003f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 0x7ff0f003f3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec003a10 tx=0x7ff0ec0092b0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 msgr2=0x7ff10019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:06.115 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4003f90 tx=0x7ff0f4011b70 comp rx=0 tx=0).stop 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 shutdown_connections 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff0f003cfb0 0x7ff0f003f3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff100109030 0x7ff10019c3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 --2- 172.21.15.43:0/749488408 >> [v2:172.21.15.43:6800/1388340659,v1:172.21.15.43:6801/1388340659] conn(0x7ff0f00396c0 0x7ff0f003bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 >> 172.21.15.43:0/749488408 conn(0x7ff100102a40 msgr2=0x7ff100103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 shutdown_connections 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:05.585+0000 7ff106d3d700 1 -- 172.21.15.43:0/749488408 wait complete. 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:mgr epoch 9 is available 2024-04-25T20:39:06.116 INFO:teuthology.orchestra.run.smithi043.stdout:Generating a dashboard self-signed certificate... 2024-04-25T20:39:06.854 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:06 smithi043 ceph-mon[29167]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T20:39:06.855 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:06 smithi043 ceph-mon[29167]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T20:39:06.855 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.874+0000 7f07df413700 1 Processor -- start 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07df413700 1 -- start start 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07df413700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07df413700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07d807be60 con 0x7f07d8109040 2024-04-25T20:39:07.743 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07dd1af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07dd1af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48718/0 (socket says 172.21.15.43:48718) 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07dd1af700 1 -- 172.21.15.43:0/2260566796 learned_addr learned my addr 172.21.15.43:0/2260566796 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07dd1af700 1 -- 172.21.15.43:0/2260566796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d810b970 con 0x7f07d8109040 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.875+0000 7f07dd1af700 1 --2- 172.21.15.43:0/2260566796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098a0 tx=0x7f07d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5236f34c6263d48b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.876+0000 7f07cffff700 1 -- 172.21.15.43:0/2260566796 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4004160 con 0x7f07d8109040 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.876+0000 7f07cffff700 1 -- 172.21.15.43:0/2260566796 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f07d4004300 con 0x7f07d8109040 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.876+0000 7f07cffff700 1 -- 172.21.15.43:0/2260566796 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d4011af0 con 0x7f07d8109040 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.876+0000 7f07df413700 1 -- 172.21.15.43:0/2260566796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 msgr2=0x7f07d810b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.876+0000 7f07df413700 1 --2- 172.21.15.43:0/2260566796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098a0 tx=0x7f07d4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 -- 172.21.15.43:0/2260566796 shutdown_connections 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 --2- 172.21.15.43:0/2260566796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d810b430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 -- 172.21.15.43:0/2260566796 >> 172.21.15.43:0/2260566796 conn(0x7f07d8102a10 msgr2=0x7f07d8104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 -- 172.21.15.43:0/2260566796 shutdown_connections 2024-04-25T20:39:07.744 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 -- 172.21.15.43:0/2260566796 wait complete. 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 Processor -- start 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.877+0000 7f07df413700 1 -- start start 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07df413700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07df413700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07d810c9d0 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07dd1af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07dd1af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48732/0 (socket says 172.21.15.43:48732) 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07dd1af700 1 -- 172.21.15.43:0/4178437740 learned_addr learned my addr 172.21.15.43:0/4178437740 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07dd1af700 1 -- 172.21.15.43:0/4178437740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d819eb60 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07dd1af700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07d4003f90 tx=0x7f07d4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40039e0 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f07d4003b80 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d819edf0 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.878+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d40196e0 con 0x7f07d8109040 2024-04-25T20:39:07.745 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.879+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d81a1ae0 con 0x7f07d8109040 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.879+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d80640a0 con 0x7f07d8109040 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.880+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f07d4022020 con 0x7f07d8109040 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.880+0000 7f07ce7fc700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 0x7f07c403ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.880+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f07d404d800 con 0x7f07d8109040 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.880+0000 7f07dc9ae700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 0x7f07c403ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.881+0000 7f07dc9ae700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 0x7f07c403ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07c8006fd0 tx=0x7f07c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:06.890+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f07d4020c10 con 0x7f07d8109040 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.137+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f07d8103b50 con 0x7f07c40395a0 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.225+0000 7f07ce7fc700 1 -- 172.21.15.43:0/4178437740 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f07d8103b50 con 0x7f07c40395a0 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 msgr2=0x7f07c403ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 0x7f07c403ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07c8006fd0 tx=0x7f07c8006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 msgr2=0x7f07d819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:07.746 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07d4003f90 tx=0x7f07d4011b70 comp rx=0 tx=0).stop 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 shutdown_connections 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f07c40395a0 0x7f07c403ba60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 --2- 172.21.15.43:0/4178437740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07d8109040 0x7f07d819e620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.227+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 >> 172.21.15.43:0/4178437740 conn(0x7f07d8102a10 msgr2=0x7f07d8103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.228+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 shutdown_connections 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:07.228+0000 7f07df413700 1 -- 172.21.15.43:0/4178437740 wait complete. 2024-04-25T20:39:07.747 INFO:teuthology.orchestra.run.smithi043.stdout:Creating initial admin user... 2024-04-25T20:39:08.433 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:08.433 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:08.433 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: [25/Apr/2024:20:39:07] ENGINE Bus STARTING 2024-04-25T20:39:08.433 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: [25/Apr/2024:20:39:07] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T20:39:08.434 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: mgrmap e12: x(active, since 2s) 2024-04-25T20:39:08.434 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:09.535 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:09 smithi043 ceph-mon[29167]: [25/Apr/2024:20:39:07] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T20:39:09.535 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:09 smithi043 ceph-mon[29167]: [25/Apr/2024:20:39:07] ENGINE Bus STARTED 2024-04-25T20:39:09.535 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OmnavTnnT66WuhTKgP8x.eWbnPkGIvUNc21dMdGhip6NsHQ7ujMfu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714077548, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.175+0000 7f69e5325700 1 Processor -- start 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.175+0000 7f69e5325700 1 -- start start 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.175+0000 7f69e5325700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.175+0000 7f69e5325700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0108fa0 con 0x7f69e01085b0 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48748/0 (socket says 172.21.15.43:48748) 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69deffd700 1 -- 172.21.15.43:0/3467536126 learned_addr learned my addr 172.21.15.43:0/3467536126 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69deffd700 1 -- 172.21.15.43:0/3467536126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e0109760 con 0x7f69e01085b0 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69deffd700 1 --2- 172.21.15.43:0/3467536126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69d40098a0 tx=0x7f69d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7df7260fe38d2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:09.544 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69ddffb700 1 -- 172.21.15.43:0/3467536126 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4004160 con 0x7f69e01085b0 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69ddffb700 1 -- 172.21.15.43:0/3467536126 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f69d4004300 con 0x7f69e01085b0 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.176+0000 7f69ddffb700 1 -- 172.21.15.43:0/3467536126 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d4011af0 con 0x7f69e01085b0 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 -- 172.21.15.43:0/3467536126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 msgr2=0x7f69e01089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 --2- 172.21.15.43:0/3467536126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69d40098a0 tx=0x7f69d4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 -- 172.21.15.43:0/3467536126 shutdown_connections 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 --2- 172.21.15.43:0/3467536126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e01089d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 -- 172.21.15.43:0/3467536126 >> 172.21.15.43:0/3467536126 conn(0x7f69e0103bb0 msgr2=0x7f69e0105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 -- 172.21.15.43:0/3467536126 shutdown_connections 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.177+0000 7f69e5325700 1 -- 172.21.15.43:0/3467536126 wait complete. 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69e5325700 1 Processor -- start 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69e5325700 1 -- start start 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69e5325700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69e5325700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010cb10 con 0x7f69e01085b0 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48754/0 (socket says 172.21.15.43:48754) 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.178+0000 7f69deffd700 1 -- 172.21.15.43:0/901750040 learned_addr learned my addr 172.21.15.43:0/901750040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69deffd700 1 -- 172.21.15.43:0/901750040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e019c970 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69deffd700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009520 tx=0x7f69d4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40036a0 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f69d401a430 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e019cc00 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69d40193c0 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.179+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e019f8f0 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.180+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f69d4019670 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.180+0000 7f69c7fff700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 0x7f69c803bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.180+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f69d404e9c0 con 0x7f69e01085b0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.180+0000 7f69de7fc700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 0x7f69c803bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:09.546 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.180+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e00640a0 con 0x7f69e01085b0 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.181+0000 7f69de7fc700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 0x7f69c803bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006fd0 tx=0x7f69d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.186+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f69d4020240 con 0x7f69e01085b0 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.432+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f69e019fac0 con 0x7f69c8039670 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.679+0000 7f69c7fff700 1 -- 172.21.15.43:0/901750040 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f69e019fac0 con 0x7f69c8039670 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 msgr2=0x7f69c803bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 0x7f69c803bb30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006fd0 tx=0x7f69d0006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 msgr2=0x7f69e019c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009520 tx=0x7f69d4003eb0 comp rx=0 tx=0).stop 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 shutdown_connections 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f69c8039670 0x7f69c803bb30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 --2- 172.21.15.43:0/901750040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69e01085b0 0x7f69e019c430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 >> 172.21.15.43:0/901750040 conn(0x7f69e0103bb0 msgr2=0x7f69e0104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 shutdown_connections 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:08.682+0000 7f69e5325700 1 -- 172.21.15.43:0/901750040 wait complete. 2024-04-25T20:39:09.547 INFO:teuthology.orchestra.run.smithi043.stdout:Fetching dashboard port number... 2024-04-25T20:39:10.527 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:10 smithi043 ceph-mon[29167]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3aba587700 1 Processor -- start 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3aba587700 1 -- start start 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3aba587700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3aba587700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab4107f40 con 0x7f3ab4107550 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48768/0 (socket says 172.21.15.43:48768) 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3ab3fff700 1 -- 172.21.15.43:0/1446606316 learned_addr learned my addr 172.21.15.43:0/1446606316 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3ab3fff700 1 -- 172.21.15.43:0/1446606316 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab4108750 con 0x7f3ab4107550 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.310+0000 7f3ab3fff700 1 --2- 172.21.15.43:0/1446606316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40098a0 tx=0x7f3aa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cd6c6cade097a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3ab2ffd700 1 -- 172.21.15.43:0/1446606316 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4004160 con 0x7f3ab4107550 2024-04-25T20:39:11.093 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3ab2ffd700 1 -- 172.21.15.43:0/1446606316 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3aa4004300 con 0x7f3ab4107550 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3ab2ffd700 1 -- 172.21.15.43:0/1446606316 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4011af0 con 0x7f3ab4107550 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 -- 172.21.15.43:0/1446606316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 msgr2=0x7f3ab4107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 --2- 172.21.15.43:0/1446606316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40098a0 tx=0x7f3aa4009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 -- 172.21.15.43:0/1446606316 shutdown_connections 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 --2- 172.21.15.43:0/1446606316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab4107970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 -- 172.21.15.43:0/1446606316 >> 172.21.15.43:0/1446606316 conn(0x7f3ab4102b30 msgr2=0x7f3ab4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 -- 172.21.15.43:0/1446606316 shutdown_connections 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.311+0000 7f3aba587700 1 -- 172.21.15.43:0/1446606316 wait complete. 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3aba587700 1 Processor -- start 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3aba587700 1 -- start start 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3aba587700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3aba587700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab410bb00 con 0x7f3ab4107550 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:11.094 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48772/0 (socket says 172.21.15.43:48772) 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.312+0000 7f3ab3fff700 1 -- 172.21.15.43:0/2579799589 learned_addr learned my addr 172.21.15.43:0/2579799589 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3ab3fff700 1 -- 172.21.15.43:0/2579799589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab419c980 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3ab3fff700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009520 tx=0x7f3aa4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa40036a0 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3aa401a430 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab419cc10 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa40193c0 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.313+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab419f900 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.314+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab40640a0 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.314+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f3aa401a5e0 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.314+0000 7f3ab17fa700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 0x7f3a9c03bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.314+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3aa404d900 con 0x7f3ab4107550 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.314+0000 7f3ab37fe700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 0x7f3a9c03bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:11.095 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.315+0000 7f3ab37fe700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 0x7f3a9c03bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8006fd0 tx=0x7f3aa8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.319+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3aa401aa60 con 0x7f3ab4107550 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.527+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f3ab402e1d0 con 0x7f3ab4107550 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.527+0000 7f3ab17fa700 1 -- 172.21.15.43:0/2579799589 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f3aa4003840 con 0x7f3ab4107550 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 msgr2=0x7f3a9c03bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 0x7f3a9c03bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8006fd0 tx=0x7f3aa8006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 msgr2=0x7f3ab419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009520 tx=0x7f3aa4003eb0 comp rx=0 tx=0).stop 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 shutdown_connections 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a9c039670 0x7f3a9c03bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 --2- 172.21.15.43:0/2579799589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ab4107550 0x7f3ab419c440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.529+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 >> 172.21.15.43:0/2579799589 conn(0x7f3ab4102b30 msgr2=0x7f3ab4192ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.530+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 shutdown_connections 2024-04-25T20:39:11.096 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:10.530+0000 7f3aba587700 1 -- 172.21.15.43:0/2579799589 wait complete. 2024-04-25T20:39:11.101 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T20:39:11.101 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout disabled 2024-04-25T20:39:11.109 INFO:teuthology.orchestra.run.smithi043.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T20:39:11.109 INFO:teuthology.orchestra.run.smithi043.stdout:systemctl: stdout inactive 2024-04-25T20:39:11.109 INFO:teuthology.orchestra.run.smithi043.stdout:firewalld.service is not enabled 2024-04-25T20:39:11.109 INFO:teuthology.orchestra.run.smithi043.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout:Ceph Dashboard is now available at: 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout: URL: https://smithi043:8443/ 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout: User: admin 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout: Password: j4q7v3wagd 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:11.111 INFO:teuthology.orchestra.run.smithi043.stdout:Saving cluster configuration to /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config directory 2024-04-25T20:39:11.112 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling autotune for osd_memory_target 2024-04-25T20:39:11.412 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:11 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2579799589' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T20:39:12.281 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.520+0000 7feaac4ec700 1 Processor -- start 2024-04-25T20:39:12.281 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.520+0000 7feaac4ec700 1 -- start start 2024-04-25T20:39:12.281 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaac4ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:12.281 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaac4ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feaa407be80 con 0x7feaa4109030 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaaa288700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaaa288700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48786/0 (socket says 172.21.15.43:48786) 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaaa288700 1 -- 172.21.15.43:0/3304910920 learned_addr learned my addr 172.21.15.43:0/3304910920 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaaa288700 1 -- 172.21.15.43:0/3304910920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa410b960 con 0x7feaa4109030 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaaa288700 1 --2- 172.21.15.43:0/3304910920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feaa00098a0 tx=0x7feaa0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4308d556e7b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaa9286700 1 -- 172.21.15.43:0/3304910920 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa0004160 con 0x7feaa4109030 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaa9286700 1 -- 172.21.15.43:0/3304910920 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feaa0004300 con 0x7feaa4109030 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.521+0000 7feaa9286700 1 -- 172.21.15.43:0/3304910920 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa0011af0 con 0x7feaa4109030 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 -- 172.21.15.43:0/3304910920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 msgr2=0x7feaa410b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 --2- 172.21.15.43:0/3304910920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feaa00098a0 tx=0x7feaa0009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 -- 172.21.15.43:0/3304910920 shutdown_connections 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 --2- 172.21.15.43:0/3304910920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa410b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:12.282 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 -- 172.21.15.43:0/3304910920 >> 172.21.15.43:0/3304910920 conn(0x7feaa4102a40 msgr2=0x7feaa4104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 -- 172.21.15.43:0/3304910920 shutdown_connections 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.522+0000 7feaac4ec700 1 -- 172.21.15.43:0/3304910920 wait complete. 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaac4ec700 1 Processor -- start 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaac4ec700 1 -- start start 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaac4ec700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaac4ec700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feaa410c960 con 0x7feaa4109030 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaaa288700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaaa288700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48792/0 (socket says 172.21.15.43:48792) 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaaa288700 1 -- 172.21.15.43:0/522367729 learned_addr learned my addr 172.21.15.43:0/522367729 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.523+0000 7feaaa288700 1 -- 172.21.15.43:0/522367729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa4108df0 con 0x7feaa4109030 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7feaaa288700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaa00117b0 tx=0x7feaa0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa00036a0 con 0x7feaa4109030 2024-04-25T20:39:12.283 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa4106fe0 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feaa001a430 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa0019530 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.524+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa4107520 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7feaa0003840 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa40640a0 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7fea9b7fe700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 0x7fea9003bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feaa004d9c0 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7feaa9a87700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 0x7fea9003bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.525+0000 7feaa9a87700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 0x7fea9003bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea94006fd0 tx=0x7fea94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.530+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feaa0003b30 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.737+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7feaa4107800 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.738+0000 7fea9b7fe700 1 -- 172.21.15.43:0/522367729 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7feaa0029260 con 0x7feaa4109030 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 msgr2=0x7fea9003bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:12.284 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 0x7fea9003bbd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea94006fd0 tx=0x7fea94006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 msgr2=0x7feaa41088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaa00117b0 tx=0x7feaa0003eb0 comp rx=0 tx=0).stop 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 shutdown_connections 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fea90039710 0x7fea9003bbd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 --2- 172.21.15.43:0/522367729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feaa4109030 0x7feaa41088b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 >> 172.21.15.43:0/522367729 conn(0x7feaa4102a40 msgr2=0x7feaa4103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 shutdown_connections 2024-04-25T20:39:12.285 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:11.740+0000 7feaac4ec700 1 -- 172.21.15.43:0/522367729 wait complete. 2024-04-25T20:39:12.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:12 smithi043 ceph-mon[29167]: mgrmap e13: x(active, since 6s) 2024-04-25T20:39:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.675+0000 7f8fa0cc5700 1 Processor -- start 2024-04-25T20:39:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8fa0cc5700 1 -- start start 2024-04-25T20:39:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8fa0cc5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8fa0cc5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c07c810 con 0x7f8f9c07de20 2024-04-25T20:39:13.565 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48808/0 (socket says 172.21.15.43:48808) 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8f9a59c700 1 -- 172.21.15.43:0/2761903222 learned_addr learned my addr 172.21.15.43:0/2761903222 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.676+0000 7f8f9a59c700 1 -- 172.21.15.43:0/2761903222 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c07c990 con 0x7f8f9c07de20 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8f9a59c700 1 --2- 172.21.15.43:0/2761903222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0098a0 tx=0x7f8f8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3fc104343388de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8f9959a700 1 -- 172.21.15.43:0/2761903222 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c004160 con 0x7f8f9c07de20 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8f9959a700 1 -- 172.21.15.43:0/2761903222 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f8c004300 con 0x7f8f9c07de20 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8f9959a700 1 -- 172.21.15.43:0/2761903222 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c011af0 con 0x7f8f9c07de20 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/2761903222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 msgr2=0x7f8f9c07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/2761903222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0098a0 tx=0x7f8f8c009bb0 comp rx=0 tx=0).stop 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/2761903222 shutdown_connections 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/2761903222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c07c2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/2761903222 >> 172.21.15.43:0/2761903222 conn(0x7f8f9c103bb0 msgr2=0x7f8f9c105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/2761903222 shutdown_connections 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.677+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/2761903222 wait complete. 2024-04-25T20:39:13.566 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8fa0cc5700 1 Processor -- start 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8fa0cc5700 1 -- start start 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8fa0cc5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8fa0cc5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10eb70 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8f9a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48816/0 (socket says 172.21.15.43:48816) 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.678+0000 7f8f9a59c700 1 -- 172.21.15.43:0/3477102106 learned_addr learned my addr 172.21.15.43:0/3477102106 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8f9a59c700 1 -- 172.21.15.43:0/3477102106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c19eb70 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8f9a59c700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0117b0 tx=0x7f8f8c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c0036a0 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c19ee00 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f8c01a430 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c019530 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.679+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a1af0 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.680+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f8f8c0196d0 con 0x7f8f9c07de20 2024-04-25T20:39:13.567 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.680+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c0640a0 con 0x7f8f9c07de20 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.680+0000 7f8f8b7fe700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 0x7f8f8403bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.680+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8f8c04db40 con 0x7f8f9c07de20 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.680+0000 7f8f99d9b700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 0x7f8f8403bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.681+0000 7f8f99d9b700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 0x7f8f8403bc30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006fd0 tx=0x7f8f90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:12.685+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8f8c02d7c0 con 0x7f8f9c07de20 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.009+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f8f9c1a20a0 con 0x7f8f9c07de20 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.011+0000 7f8f8b7fe700 1 -- 172.21.15.43:0/3477102106 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f8f8c01a970 con 0x7f8f9c07de20 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.013+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 msgr2=0x7f8f8403bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 0x7f8f8403bc30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006fd0 tx=0x7f8f90006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 msgr2=0x7f8f9c19e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0117b0 tx=0x7f8f8c004610 comp rx=0 tx=0).stop 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 shutdown_connections 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8f84039770 0x7f8f8403bc30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 --2- 172.21.15.43:0/3477102106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f9c07de20 0x7f8f9c19e630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 >> 172.21.15.43:0/3477102106 conn(0x7f8f9c103bb0 msgr2=0x7f8f9c1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:13.568 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 shutdown_connections 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr 2024-04-25T20:39:13.014+0000 7f8fa0cc5700 1 -- 172.21.15.43:0/3477102106 wait complete. 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: ceph telemetry on 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout:For more information see: 2024-04-25T20:39:13.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-25T20:39:13.570 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:13.570 INFO:teuthology.orchestra.run.smithi043.stdout:Bootstrap complete. 2024-04-25T20:39:13.608 INFO:tasks.cephadm:Fetching config... 2024-04-25T20:39:13.609 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:39:13.609 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T20:39:13.625 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T20:39:13.625 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:39:13.626 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T20:39:13.681 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T20:39:13.681 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:39:13.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-25T20:39:13.747 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T20:39:13.747 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:39:13.747 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T20:39:13.803 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T20:39:13.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T20:39:13.876 INFO:teuthology.orchestra.run.smithi043.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:13.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T20:39:13.926 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:13.937 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T20:39:13.988 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIxBkA0qVc/2f25I/iIkdIpTzvii8LiqzM6D2bItTRNJeVDjt4zNoiW3yTj/wdca35z0O+s387KZU4FJrwSB0OpYAlisQD+wzxw69uFU9CWfoFhsp6ZbJvkG6lW2FYvDqqUmKuUyC/7KhxtOcB6XOasQ6MdPd5RB2gDbsrgDbMtyI+MdA1dJLqOfI9uRctvoAHSNJbwutX5B9iDbPjc2Q9RxZRPtSDB5PBNZw0rtz39QUPWeeahlbAswGkLKzYwHGMHnU/S/DR72xXSPHQ8/UwJucj2p7OOwVL9oEd5kC+d5ie+6YWTdgh8OxMyztf6KFRI7g8Jy4cYghsdHdvTNjX0mTM0s0q3l2bIgGdgLp/VgiuiX7eKlHNQaMS41VTrCX3Xyfwz7CC0ljRj9eTx8ZPKfWIW1HoSRiCjTKCQ1inm0ccjctfea/trVOOEHMuDF4K/+aLRKmmR/GRNTHNho2UelVBU7j5cs+vCcpq4O7E/lPUGUsYvEeLYCsFaY1Ubas= ceph-92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:14.000 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T20:39:14.144 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:14 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3477102106' entity='client.admin' 2024-04-25T20:39:14.252 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 -- 172.21.15.43:0/320686577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 msgr2=0x7f18dc1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 --2- 172.21.15.43:0/320686577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc1017c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009910 tx=0x7f18d8009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 -- 172.21.15.43:0/320686577 shutdown_connections 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 --2- 172.21.15.43:0/320686577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc1017c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 -- 172.21.15.43:0/320686577 >> 172.21.15.43:0/320686577 conn(0x7f18dc0fc940 msgr2=0x7f18dc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:16.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 -- 172.21.15.43:0/320686577 shutdown_connections 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.022+0000 7f18e3f58700 1 -- 172.21.15.43:0/320686577 wait complete. 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e3f58700 1 Processor -- start 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e3f58700 1 -- start start 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e3f58700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e3f58700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18dc107420 con 0x7f18dc1013a0 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e1cf4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e1cf4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51114/0 (socket says 172.21.15.43:51114) 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.023+0000 7f18e1cf4700 1 -- 172.21.15.43:0/1630440070 learned_addr learned my addr 172.21.15.43:0/1630440070 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18e1cf4700 1 -- 172.21.15.43:0/1630440070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18dc198040 con 0x7f18dc1013a0 2024-04-25T20:39:16.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18e1cf4700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d8005830 tx=0x7f18d8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d8027070 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18d8022470 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18dc1982d0 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18d800f5b0 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.024+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18dc19afc0 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.025+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f18d802a070 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.025+0000 7f18d2ffd700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 0x7f18c803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.025+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18dc107ba0 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.025+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f18d801e030 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.025+0000 7f18e14f3700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 0x7f18c803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.026+0000 7f18e14f3700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 0x7f18c803bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f18cc006fd0 tx=0x7f18cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.031+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18d8013070 con 0x7f18dc1013a0 2024-04-25T20:39:16.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.242+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f18dc02e090 con 0x7f18dc1013a0 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.245+0000 7f18d2ffd700 1 -- 172.21.15.43:0/1630440070 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f18d80292c0 con 0x7f18dc1013a0 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 msgr2=0x7f18c803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 0x7f18c803bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f18cc006fd0 tx=0x7f18cc006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 msgr2=0x7f18dc197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d8005830 tx=0x7f18d8009e60 comp rx=0 tx=0).stop 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 shutdown_connections 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f18c80396b0 0x7f18c803bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 --2- 172.21.15.43:0/1630440070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18dc1013a0 0x7f18dc197b00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.247+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 >> 172.21.15.43:0/1630440070 conn(0x7f18dc0fc940 msgr2=0x7f18dc06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.248+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 shutdown_connections 2024-04-25T20:39:16.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:16.248+0000 7f18e3f58700 1 -- 172.21.15.43:0/1630440070 wait complete. 2024-04-25T20:39:17.030 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T20:39:17.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T20:39:17.315 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:17 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1630440070' entity='client.admin' 2024-04-25T20:39:17.498 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:19.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 -- 172.21.15.43:0/3894187346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 msgr2=0x7fd9681028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 --2- 172.21.15.43:0/3894187346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd9681028c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd950009910 tx=0x7fd950009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 -- 172.21.15.43:0/3894187346 shutdown_connections 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 --2- 172.21.15.43:0/3894187346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd9681028c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 -- 172.21.15.43:0/3894187346 >> 172.21.15.43:0/3894187346 conn(0x7fd9680fda40 msgr2=0x7fd9680ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 -- 172.21.15.43:0/3894187346 shutdown_connections 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.082+0000 7fd96ec60700 1 -- 172.21.15.43:0/3894187346 wait complete. 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96ec60700 1 Processor -- start 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96ec60700 1 -- start start 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96ec60700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96ec60700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd968108520 con 0x7fd9681024a0 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96c9fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:19.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96c9fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51142/0 (socket says 172.21.15.43:51142) 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96c9fc700 1 -- 172.21.15.43:0/4081594002 learned_addr learned my addr 172.21.15.43:0/4081594002 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.083+0000 7fd96c9fc700 1 -- 172.21.15.43:0/4081594002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd968198070 con 0x7fd9681024a0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd96c9fc700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd950005830 tx=0x7fd950009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd950027070 con 0x7fd9681024a0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd950022470 con 0x7fd9681024a0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95000f5b0 con 0x7fd9681024a0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd968198300 con 0x7fd9681024a0 2024-04-25T20:39:19.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.084+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96819aff0 con 0x7fd9681024a0 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.085+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd95002a070 con 0x7fd9681024a0 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.085+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd968108ca0 con 0x7fd9681024a0 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.085+0000 7fd965ffb700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 0x7fd95403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.085+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd95001e030 con 0x7fd9681024a0 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.085+0000 7fd967fff700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 0x7fd95403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:19.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.086+0000 7fd967fff700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 0x7fd95403bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd95800ad30 tx=0x7fd9580093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:19.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.090+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd950013070 con 0x7fd9681024a0 2024-04-25T20:39:19.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.303+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fd96802e120 con 0x7fd9540396b0 2024-04-25T20:39:19.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.306+0000 7fd965ffb700 1 -- 172.21.15.43:0/4081594002 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd96802e120 con 0x7fd9540396b0 2024-04-25T20:39:19.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 msgr2=0x7fd95403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:19.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 0x7fd95403bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd95800ad30 tx=0x7fd9580093f0 comp rx=0 tx=0).stop 2024-04-25T20:39:19.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 msgr2=0x7fd968197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd950005830 tx=0x7fd950009e60 comp rx=0 tx=0).stop 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 shutdown_connections 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd9540396b0 0x7fd95403bb70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 --2- 172.21.15.43:0/4081594002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9681024a0 0x7fd968197b30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.308+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 >> 172.21.15.43:0/4081594002 conn(0x7fd9680fda40 msgr2=0x7fd9680fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.309+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 shutdown_connections 2024-04-25T20:39:19.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:19.309+0000 7fd96ec60700 1 -- 172.21.15.43:0/4081594002 wait complete. 2024-04-25T20:39:20.133 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-04-25T20:39:20.133 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:39:20.133 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-04-25T20:39:20.154 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:39:20.154 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:20.210 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-04-25T20:39:20.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch host add smithi112 2024-04-25T20:39:20.458 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:20.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:20.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:20.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:20.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:20.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi043", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:39:20.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:20.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:21.500 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.984+0000 7f619fc8d700 1 -- 172.21.15.43:0/4122894243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 msgr2=0x7f61981088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.984+0000 7f619fc8d700 1 --2- 172.21.15.43:0/4122894243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f61981088c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6194009910 tx=0x7f6194009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 -- 172.21.15.43:0/4122894243 shutdown_connections 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 --2- 172.21.15.43:0/4122894243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f61981088c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 -- 172.21.15.43:0/4122894243 >> 172.21.15.43:0/4122894243 conn(0x7f61980fdf80 msgr2=0x7f61981003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 -- 172.21.15.43:0/4122894243 shutdown_connections 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 -- 172.21.15.43:0/4122894243 wait complete. 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 Processor -- start 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.985+0000 7f619fc8d700 1 -- start start 2024-04-25T20:39:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619fc8d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619fc8d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f619810ca80 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619da29700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619da29700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51150/0 (socket says 172.21.15.43:51150) 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619da29700 1 -- 172.21.15.43:0/1173393814 learned_addr learned my addr 172.21.15.43:0/1173393814 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619da29700 1 -- 172.21.15.43:0/1173393814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61981984a0 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619da29700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6194005780 tx=0x7f61940057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6194026070 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6194004370 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6194003a30 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6198198790 con 0x7f61981084e0 2024-04-25T20:39:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.986+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619819c7e0 con 0x7f61981084e0 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.987+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f6194029070 con 0x7f61981084e0 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.987+0000 7f618affd700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 0x7f618403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.987+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6198103b90 con 0x7f61981084e0 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.988+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f619401e070 con 0x7f61981084e0 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.988+0000 7f619d228700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 0x7f618403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.988+0000 7f619d228700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 0x7f618403bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f618c006fd0 tx=0x7f618c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:21.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:21.993+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6194013070 con 0x7f61981084e0 2024-04-25T20:39:22.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:22.204+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}) -- 0x7f6198199270 con 0x7f6184039650 2024-04-25T20:39:22.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:22 smithi043 ceph-mon[29167]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:23.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:23 smithi043 ceph-mon[29167]: Deploying cephadm binary to smithi112 2024-04-25T20:39:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:25 smithi043 ceph-mon[29167]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:26.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.553+0000 7f618affd700 1 -- 172.21.15.43:0/1173393814 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6198199270 con 0x7f6184039650 2024-04-25T20:39:26.555 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 msgr2=0x7f618403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 0x7f618403bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f618c006fd0 tx=0x7f618c006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 msgr2=0x7f6198197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6194005780 tx=0x7f61940057b0 comp rx=0 tx=0).stop 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 shutdown_connections 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6184039650 0x7f618403bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 --2- 172.21.15.43:0/1173393814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61981084e0 0x7f6198197f60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:26.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 >> 172.21.15.43:0/1173393814 conn(0x7f61980fdf80 msgr2=0x7f6198109f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:26.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 shutdown_connections 2024-04-25T20:39:26.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:26.556+0000 7f619fc8d700 1 -- 172.21.15.43:0/1173393814 wait complete. 2024-04-25T20:39:27.146 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T20:39:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:27.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:27.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:27 smithi043 ceph-mon[29167]: Added host smithi112 2024-04-25T20:39:27.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:27.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:27 smithi043 ceph-mon[29167]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:27.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:28.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.966+0000 7fd24180a700 1 -- 172.21.15.43:0/3952922598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 msgr2=0x7fd23c108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.966+0000 7fd24180a700 1 --2- 172.21.15.43:0/3952922598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c108930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009910 tx=0x7fd22c009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 -- 172.21.15.43:0/3952922598 shutdown_connections 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 --2- 172.21.15.43:0/3952922598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c108930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 -- 172.21.15.43:0/3952922598 >> 172.21.15.43:0/3952922598 conn(0x7fd23c0fdf70 msgr2=0x7fd23c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 -- 172.21.15.43:0/3952922598 shutdown_connections 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 -- 172.21.15.43:0/3952922598 wait complete. 2024-04-25T20:39:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 Processor -- start 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.967+0000 7fd24180a700 1 -- start start 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd24180a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd24180a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c10cb00 con 0x7fd23c108550 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd23affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd23affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49802/0 (socket says 172.21.15.43:49802) 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd23affd700 1 -- 172.21.15.43:0/4213704937 learned_addr learned my addr 172.21.15.43:0/4213704937 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd23affd700 1 -- 172.21.15.43:0/4213704937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c1983b0 con 0x7fd23c108550 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd23affd700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd22c005780 tx=0x7fd22c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:28.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c026070 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c198640 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd22c004370 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22c003af0 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.968+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c19c740 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.969+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fd22c029070 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.969+0000 7fd240808700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 0x7fd22403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.969+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd22c01e070 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.969+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c103bc0 con 0x7fd23c108550 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.970+0000 7fd23a7fc700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 0x7fd22403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:28.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.970+0000 7fd23a7fc700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 0x7fd22403bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd230006fd0 tx=0x7fd230006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:28.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:28.975+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd22c030020 con 0x7fd23c108550 2024-04-25T20:39:29.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.187+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd23c0640a0 con 0x7fd224039650 2024-04-25T20:39:29.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.188+0000 7fd240808700 1 -- 172.21.15.43:0/4213704937 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fd23c0640a0 con 0x7fd224039650 2024-04-25T20:39:29.190 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:29.190 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 msgr2=0x7fd22403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 0x7fd22403bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd230006fd0 tx=0x7fd230006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 msgr2=0x7fd23c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd22c005780 tx=0x7fd22c0057b0 comp rx=0 tx=0).stop 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 shutdown_connections 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd224039650 0x7fd22403bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:29.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 --2- 172.21.15.43:0/4213704937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd23c108550 0x7fd23c197e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:29.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 >> 172.21.15.43:0/4213704937 conn(0x7fd23c0fdf70 msgr2=0x7fd23c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:29.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 shutdown_connections 2024-04-25T20:39:29.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:29.190+0000 7fd24180a700 1 -- 172.21.15.43:0/4213704937 wait complete. 2024-04-25T20:39:29.828 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-04-25T20:39:29.828 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:39:29.828 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-04-25T20:39:29.847 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:39:29.848 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:29.905 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-04-25T20:39:29.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch host add smithi195 2024-04-25T20:39:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:30 smithi043 ceph-mon[29167]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:30.483 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:30 smithi043 ceph-mon[29167]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:39:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.493+0000 7f2ac4c71700 1 -- 172.21.15.43:0/603917109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 msgr2=0x7f2ac0107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.493+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/603917109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0107850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009910 tx=0x7f2ab0009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 -- 172.21.15.43:0/603917109 shutdown_connections 2024-04-25T20:39:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/603917109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0107850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:31.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 -- 172.21.15.43:0/603917109 >> 172.21.15.43:0/603917109 conn(0x7f2ac00fc1b0 msgr2=0x7f2ac00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 -- 172.21.15.43:0/603917109 shutdown_connections 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 -- 172.21.15.43:0/603917109 wait complete. 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.494+0000 7f2ac4c71700 1 Processor -- start 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2ac4c71700 1 -- start start 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2ac4c71700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2ac4c71700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010cab0 con 0x7f2ac0107470 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2abe59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2abe59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49832/0 (socket says 172.21.15.43:49832) 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2abe59c700 1 -- 172.21.15.43:0/2510375704 learned_addr learned my addr 172.21.15.43:0/2510375704 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2abe59c700 1 -- 172.21.15.43:0/2510375704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac0198430 con 0x7f2ac0107470 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2abe59c700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0006010 tx=0x7f2ab0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab0027070 con 0x7f2ac0107470 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ab000be30 con 0x7f2ac0107470 2024-04-25T20:39:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac01986c0 con 0x7f2ac0107470 2024-04-25T20:39:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.495+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab000f460 con 0x7f2ac0107470 2024-04-25T20:39:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.496+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac019c770 con 0x7f2ac0107470 2024-04-25T20:39:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.496+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2ab002a070 con 0x7f2ac0107470 2024-04-25T20:39:31.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.497+0000 7f2aaf7fe700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 0x7f2aa803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:31.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.497+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ab001e030 con 0x7f2ac0107470 2024-04-25T20:39:31.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.497+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac0101970 con 0x7f2ac0107470 2024-04-25T20:39:31.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.497+0000 7f2abdd9b700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 0x7f2aa803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:31.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.497+0000 7f2abdd9b700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 0x7f2aa803bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4006fd0 tx=0x7f2ab4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.502+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2ab0031070 con 0x7f2ac0107470 2024-04-25T20:39:31.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:31.713+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) -- 0x7f2ac0199200 con 0x7f2aa80396b0 2024-04-25T20:39:32.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:32 smithi043 ceph-mon[29167]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:33.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:33.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:33.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:33 smithi043 ceph-mon[29167]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:39:34.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:34 smithi043 ceph-mon[29167]: Deploying cephadm binary to smithi195 2024-04-25T20:39:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:34 smithi043 ceph-mon[29167]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:34 smithi043 ceph-mon[29167]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:34 smithi043 ceph-mon[29167]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:34 smithi043 ceph-mon[29167]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:39:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.123+0000 7f2aaf7fe700 1 -- 172.21.15.43:0/2510375704 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2ac0199200 con 0x7f2aa80396b0 2024-04-25T20:39:36.125 INFO:teuthology.orchestra.run.smithi043.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-04-25T20:39:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.125+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 msgr2=0x7f2aa803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.125+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 0x7f2aa803bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4006fd0 tx=0x7f2ab4006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.125+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 msgr2=0x7f2ac0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.125+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0006010 tx=0x7f2ab0009ec0 comp rx=0 tx=0).stop 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 shutdown_connections 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2aa80396b0 0x7f2aa803bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 --2- 172.21.15.43:0/2510375704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ac0107470 0x7f2ac0197ef0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 >> 172.21.15.43:0/2510375704 conn(0x7f2ac00fc1b0 msgr2=0x7f2ac0109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 shutdown_connections 2024-04-25T20:39:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:36.126+0000 7f2ac4c71700 1 -- 172.21.15.43:0/2510375704 wait complete. 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:36.425 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:36.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T20:39:36.949 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:37.329 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:37 smithi043 ceph-mon[29167]: Added host smithi195 2024-04-25T20:39:37.329 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:37 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:37.329 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:37 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 -- 172.21.15.43:0/3584414500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 msgr2=0x7fdee4075250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/3584414500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee4075250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00b0a0 tx=0x7fdedc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 -- 172.21.15.43:0/3584414500 shutdown_connections 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/3584414500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee4075250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 -- 172.21.15.43:0/3584414500 >> 172.21.15.43:0/3584414500 conn(0x7fdee40fdf80 msgr2=0x7fdee41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 -- 172.21.15.43:0/3584414500 shutdown_connections 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.438+0000 7fdeec1f6700 1 -- 172.21.15.43:0/3584414500 wait complete. 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdeec1f6700 1 Processor -- start 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdeec1f6700 1 -- start start 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdeec1f6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdeec1f6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdee410ece0 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdee9f92700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdee9f92700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41240/0 (socket says 172.21.15.43:41240) 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdee9f92700 1 -- 172.21.15.43:0/232371376 learned_addr learned my addr 172.21.15.43:0/232371376 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdee9f92700 1 -- 172.21.15.43:0/232371376 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee419a750 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.439+0000 7fdee9f92700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0062a0 tx=0x7fdedc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.440+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdedc017040 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.440+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdedc022070 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.440+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee419a9e0 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.440+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdedc01d450 con 0x7fdee4074e70 2024-04-25T20:39:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.440+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee419ae40 con 0x7fdee4074e70 2024-04-25T20:39:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.441+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fdedc01d700 con 0x7fdee4074e70 2024-04-25T20:39:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.441+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee4076520 con 0x7fdee4074e70 2024-04-25T20:39:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.441+0000 7fdee2ffd700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 0x7fdecc03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.441+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdedc00f050 con 0x7fdee4074e70 2024-04-25T20:39:38.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.441+0000 7fdee9791700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 0x7fdecc03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:38.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.442+0000 7fdee9791700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 0x7fdecc03bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:38.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.446+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdedc02ce40 con 0x7fdee4074e70 2024-04-25T20:39:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:38 smithi043 ceph-mon[29167]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:38.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.661+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdee419b5e0 con 0x7fdecc0396b0 2024-04-25T20:39:38.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.663+0000 7fdee2ffd700 1 -- 172.21.15.43:0/232371376 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fdee419b5e0 con 0x7fdecc0396b0 2024-04-25T20:39:38.664 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:39:38.664 INFO:teuthology.orchestra.run.smithi043.stdout:[{"addr": "172.21.15.43", "hostname": "smithi043", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-04-25T20:39:38.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 msgr2=0x7fdecc03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 0x7fdecc03bb70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 msgr2=0x7fdee419a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0062a0 tx=0x7fdedc003ce0 comp rx=0 tx=0).stop 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 shutdown_connections 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdecc0396b0 0x7fdecc03bb70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 --2- 172.21.15.43:0/232371376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee4074e70 0x7fdee419a210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 >> 172.21.15.43:0/232371376 conn(0x7fdee40fdf80 msgr2=0x7fdee41066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 shutdown_connections 2024-04-25T20:39:38.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:38.665+0000 7fdeec1f6700 1 -- 172.21.15.43:0/232371376 wait complete. 2024-04-25T20:39:39.250 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T20:39:39.250 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T20:39:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:39:39.940 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:39 smithi043 ceph-mon[29167]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:39.940 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:39 smithi043 ceph-mon[29167]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:39:39.940 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 -- 172.21.15.43:0/1900880414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 msgr2=0x7f82f0108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/1900880414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0108930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009910 tx=0x7f82e0009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 -- 172.21.15.43:0/1900880414 shutdown_connections 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/1900880414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0108930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 -- 172.21.15.43:0/1900880414 >> 172.21.15.43:0/1900880414 conn(0x7f82f00fdf70 msgr2=0x7f82f0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:40.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 -- 172.21.15.43:0/1900880414 shutdown_connections 2024-04-25T20:39:40.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.819+0000 7f82f5a4a700 1 -- 172.21.15.43:0/1900880414 wait complete. 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.820+0000 7f82f5a4a700 1 Processor -- start 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.820+0000 7f82f5a4a700 1 -- start start 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.820+0000 7f82f5a4a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.820+0000 7f82f5a4a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010cb00 con 0x7f82f0108550 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:40.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41268/0 (socket says 172.21.15.43:41268) 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82eeffd700 1 -- 172.21.15.43:0/3976772425 learned_addr learned my addr 172.21.15.43:0/3976772425 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82eeffd700 1 -- 172.21.15.43:0/3976772425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f0076c30 con 0x7f82f0108550 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82eeffd700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82e0005780 tx=0x7f82e00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0026070 con 0x7f82f0108550 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f0075280 con 0x7f82f0108550 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82e0004370 con 0x7f82f0108550 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0003af0 con 0x7f82f0108550 2024-04-25T20:39:40.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.821+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f0075740 con 0x7f82f0108550 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.822+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f82e0029070 con 0x7f82f0108550 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.822+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0103bc0 con 0x7f82f0108550 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.822+0000 7f82f4a48700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 0x7f82d803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.822+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f82e001e070 con 0x7f82f0108550 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.823+0000 7f82ee7fc700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 0x7f82d803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:40.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.823+0000 7f82ee7fc700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 0x7f82d803bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f82e4006fd0 tx=0x7f82e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:40.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:40.828+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f82e0013070 con 0x7f82f0108550 2024-04-25T20:39:41.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.040+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f82f0076270 con 0x7f82f0108550 2024-04-25T20:39:41.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.705+0000 7f82f4a48700 1 -- 172.21.15.43:0/3976772425 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f82e000ece0 con 0x7f82f0108550 2024-04-25T20:39:41.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 msgr2=0x7f82d803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 0x7f82d803bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f82e4006fd0 tx=0x7f82e4006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 msgr2=0x7f82f0074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f82e0005780 tx=0x7f82e00057b0 comp rx=0 tx=0).stop 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 shutdown_connections 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f82d8039650 0x7f82d803bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 --2- 172.21.15.43:0/3976772425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82f0108550 0x7f82f0074d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 >> 172.21.15.43:0/3976772425 conn(0x7f82f00fdf70 msgr2=0x7f82f00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 shutdown_connections 2024-04-25T20:39:41.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:39:41.708+0000 7f82f5a4a700 1 -- 172.21.15.43:0/3976772425 wait complete. 2024-04-25T20:39:41.711 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-04-25T20:39:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:41 smithi043 ceph-mon[29167]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:41 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3976772425' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T20:39:42.428 INFO:tasks.cephadm:Adding mon.a on smithi043 2024-04-25T20:39:42.428 INFO:tasks.cephadm:Adding mon.b on smithi112 2024-04-25T20:39:42.428 INFO:tasks.cephadm:Adding mon.c on smithi195 2024-04-25T20:39:42.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c' 2024-04-25T20:39:42.659 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3976772425' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:39:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:43.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 -- 172.21.15.195:0/966599341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 msgr2=0x7f3c08103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/966599341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08103a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009910 tx=0x7f3bf8009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 -- 172.21.15.195:0/966599341 shutdown_connections 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/966599341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08103a90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 -- 172.21.15.195:0/966599341 >> 172.21.15.195:0/966599341 conn(0x7f3c080fce40 msgr2=0x7f3c080ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:44.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 -- 172.21.15.195:0/966599341 shutdown_connections 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.009+0000 7f3c0c82a700 1 -- 172.21.15.195:0/966599341 wait complete. 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0c82a700 1 Processor -- start 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0c82a700 1 -- start start 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0c82a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0c82a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0810caf0 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.195:53038/0 (socket says 172.21.15.195:53038) 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.010+0000 7f3c0659c700 1 -- 172.21.15.195:0/1172615155 learned_addr learned my addr 172.21.15.195:0/1172615155 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3c0659c700 1 -- 172.21.15.195:0/1172615155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c08198480 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3c0659c700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80057a0 tx=0x7f3bf8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf8026070 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3bf8004370 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c08198710 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf8003b90 con 0x7f3c081036b0 2024-04-25T20:39:44.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.011+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c08198b70 con 0x7f3c081036b0 2024-04-25T20:39:44.014 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.012+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0806b0f0 con 0x7f3c081036b0 2024-04-25T20:39:44.014 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.012+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3bf8029070 con 0x7f3c081036b0 2024-04-25T20:39:44.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.012+0000 7f3bf77fe700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 0x7f3bf003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:44.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.012+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3bf801e070 con 0x7f3c081036b0 2024-04-25T20:39:44.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.012+0000 7f3c05d9b700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 0x7f3bf003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:44.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.013+0000 7f3c05d9b700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 0x7f3bf003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:44.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.018+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3bf8013070 con 0x7f3c081036b0 2024-04-25T20:39:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:43 smithi043 ceph-mon[29167]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:44.230 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.228+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}) -- 0x7f3c08104b50 con 0x7f3bf0039650 2024-04-25T20:39:44.236 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.235+0000 7f3bf77fe700 1 -- 172.21.15.195:0/1172615155 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3c08104b50 con 0x7f3bf0039650 2024-04-25T20:39:44.237 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-04-25T20:39:44.238 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 msgr2=0x7f3bf003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 0x7f3bf003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 msgr2=0x7f3c08197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80057a0 tx=0x7f3bf8005dc0 comp rx=0 tx=0).stop 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 shutdown_connections 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3bf0039650 0x7f3bf003bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 --2- 172.21.15.195:0/1172615155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c081036b0 0x7f3c08197f40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 >> 172.21.15.195:0/1172615155 conn(0x7f3c080fce40 msgr2=0x7f3c08104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 shutdown_connections 2024-04-25T20:39:44.239 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:44.237+0000 7f3c0c82a700 1 -- 172.21.15.195:0/1172615155 wait complete. 2024-04-25T20:39:44.818 DEBUG:teuthology.orchestra.run.smithi112:mon.b> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.b.service 2024-04-25T20:39:44.821 DEBUG:teuthology.orchestra.run.smithi195:mon.c> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.c.service 2024-04-25T20:39:44.823 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T20:39:44.823 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T20:39:45.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c;count:3 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:45.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:45 smithi043 ceph-mon[29167]: Deploying daemon mon.c on smithi195 2024-04-25T20:39:45.928 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:46.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:46 smithi043 ceph-mon[29167]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:48.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 -- 172.21.15.195:0/226580295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 msgr2=0x7f6e64108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:48.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 --2- 172.21.15.195:0/226580295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e64108810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009910 tx=0x7f6e58009c20 comp rx=0 tx=0).stop 2024-04-25T20:39:48.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 -- 172.21.15.195:0/226580295 shutdown_connections 2024-04-25T20:39:48.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 --2- 172.21.15.195:0/226580295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e64108810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:48.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 -- 172.21.15.195:0/226580295 >> 172.21.15.195:0/226580295 conn(0x7f6e640788d0 msgr2=0x7f6e64078ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 -- 172.21.15.195:0/226580295 shutdown_connections 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.334+0000 7f6e6b145700 1 -- 172.21.15.195:0/226580295 wait complete. 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e6b145700 1 Processor -- start 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e6b145700 1 -- start start 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e6b145700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e6b145700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6410ca60 con 0x7f6e64108430 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e68ee1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e68ee1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.195:57514/0 (socket says 172.21.15.195:57514) 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.335+0000 7f6e68ee1700 1 -- 172.21.15.195:0/537874771 learned_addr learned my addr 172.21.15.195:0/537874771 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e68ee1700 1 -- 172.21.15.195:0/537874771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6419a580 con 0x7f6e64108430 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e68ee1700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005780 tx=0x7f6e580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58026070 con 0x7f6e64108430 2024-04-25T20:39:48.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6419a870 con 0x7f6e64108430 2024-04-25T20:39:48.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6e58004370 con 0x7f6e64108430 2024-04-25T20:39:48.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e58003a30 con 0x7f6e64108430 2024-04-25T20:39:48.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.336+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6419e910 con 0x7f6e64108430 2024-04-25T20:39:48.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.337+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6406a620 con 0x7f6e64108430 2024-04-25T20:39:48.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.337+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f6e58029070 con 0x7f6e64108430 2024-04-25T20:39:48.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.337+0000 7f6e61ffb700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 0x7f6e5403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:48.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.337+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e5801e070 con 0x7f6e64108430 2024-04-25T20:39:48.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.338+0000 7f6e63fff700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 0x7f6e5403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:48.340 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.338+0000 7f6e63fff700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 0x7f6e5403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:48.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.343+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6e58013070 con 0x7f6e64108430 2024-04-25T20:39:48.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:48 smithi043 ceph-mon[29167]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:48.634 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.632+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6e6419b3a0 con 0x7f6e64108430 2024-04-25T20:39:48.634 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.633+0000 7f6e61ffb700 1 -- 172.21.15.195:0/537874771 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f6e58030090 con 0x7f6e64108430 2024-04-25T20:39:48.635 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:39:48.635 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","modified":"2024-04-25T20:37:56.803474Z","created":"2024-04-25T20:37:56.803474Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 msgr2=0x7f6e5403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 0x7f6e5403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50006e40 comp rx=0 tx=0).stop 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 msgr2=0x7f6e6419a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005780 tx=0x7f6e580057b0 comp rx=0 tx=0).stop 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 shutdown_connections 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6e54039650 0x7f6e5403bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 --2- 172.21.15.195:0/537874771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e64108430 0x7f6e6419a040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:48.637 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.635+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 >> 172.21.15.195:0/537874771 conn(0x7f6e640788d0 msgr2=0x7f6e640fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:48.638 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.636+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 shutdown_connections 2024-04-25T20:39:48.638 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:48.636+0000 7f6e6b145700 1 -- 172.21.15.195:0/537874771 wait complete. 2024-04-25T20:39:48.638 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-04-25T20:39:49.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:49 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/537874771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:39:49.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:49 smithi195 systemd[1]: Started Ceph mon.c for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:39:50.192 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T20:39:50.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T20:39:50.429 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: mon.a calling monitor election 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: mon.c calling monitor election 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: monmap epoch 2 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: last_changed 2024-04-25T20:39:49.340489+0000 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: min_mon_release 19 (squid) 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: election_strategy: 1 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: fsmap 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:39:54.797 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: mgrmap e13: x(active, since 49s) 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: overall HEALTH_OK 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:39:54.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:39:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: mon.a calling monitor election 2024-04-25T20:39:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: mon.c calling monitor election 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: monmap epoch 2 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: last_changed 2024-04-25T20:39:49.340489+0000 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:39:54.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: min_mon_release 19 (squid) 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: election_strategy: 1 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: fsmap 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: mgrmap e13: x(active, since 49s) 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: overall HEALTH_OK 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:39:54.844 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 -- 172.21.15.195:0/3767704490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040035c0 msgr2=0x7f2704005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 --2- 172.21.15.195:0/3767704490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040035c0 0x7f2704005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f271c06ac20 tx=0x7f270c00fe60 comp rx=0 tx=0).stop 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 -- 172.21.15.195:0/3767704490 shutdown_connections 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 --2- 172.21.15.195:0/3767704490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040035c0 0x7f2704005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 -- 172.21.15.195:0/3767704490 >> 172.21.15.195:0/3767704490 conn(0x7f271c077ab0 msgr2=0x7f271c077ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 -- 172.21.15.195:0/3767704490 shutdown_connections 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.928+0000 7f2721e66700 1 -- 172.21.15.195:0/3767704490 wait complete. 2024-04-25T20:39:54.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 Processor -- start 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 -- start start 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f271c109580 con 0x7f271c19a950 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.929+0000 7f2721e66700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f271c109400 con 0x7f27040035c0 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.195:41260/0 (socket says 172.21.15.195:41260) 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:49536/0 (socket says 172.21.15.195:49536) 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 -- 172.21.15.195:0/171158866 learned_addr learned my addr 172.21.15.195:0/171158866 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 -- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 msgr2=0x7f271c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T20:39:54.932 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 -- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 msgr2=0x7f271c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271b7fe700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 -- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 msgr2=0x7f271c19a410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 -- 172.21.15.195:0/171158866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c19af90 con 0x7f271c19a950 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f271affd700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f271000b700 tx=0x7f271000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2710011630 con 0x7f271c19a950 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2710011ca0 con 0x7f271c19a950 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.930+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c19f1d0 con 0x7f271c19a950 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.931+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2710010e50 con 0x7f271c19a950 2024-04-25T20:39:54.933 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.931+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c19f7b0 con 0x7f271c19a950 2024-04-25T20:39:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.931+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2710018020 con 0x7f271c19a950 2024-04-25T20:39:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.932+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c19fac0 con 0x7f271c19a950 2024-04-25T20:39:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.932+0000 7f2718ff9700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 0x7f270803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:39:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.932+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f271004c1c0 con 0x7f271c19a950 2024-04-25T20:39:54.934 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.932+0000 7f271b7fe700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 0x7f270803bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:39:54.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.932+0000 7f271b7fe700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 0x7f270803bac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f270c00fa10 tx=0x7f270c00f3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:39:54.938 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:54.938+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f271c19fac0 con 0x7f271c19a950 2024-04-25T20:39:55.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.217+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f271c19b720 con 0x7f271c19a950 2024-04-25T20:39:55.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.218+0000 7f2718ff9700 1 -- 172.21.15.195:0/171158866 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f271001f020 con 0x7f271c19a950 2024-04-25T20:39:55.219 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:39:55.219 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","modified":"2024-04-25T20:39:49.340489Z","created":"2024-04-25T20:37:56.803474Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T20:39:55.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 msgr2=0x7f270803bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:55.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 0x7f270803bac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f270c00fa10 tx=0x7f270c00f3c0 comp rx=0 tx=0).stop 2024-04-25T20:39:55.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 msgr2=0x7f271c19ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f271000b700 tx=0x7f271000bac0 comp rx=0 tx=0).stop 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 shutdown_connections 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2708039600 0x7f270803bac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27040035c0 0x7f271c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 --2- 172.21.15.195:0/171158866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271c19a950 0x7f271c19ec90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 >> 172.21.15.195:0/171158866 conn(0x7f271c077ab0 msgr2=0x7f271c105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 shutdown_connections 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:39:55.220+0000 7f2721e66700 1 -- 172.21.15.195:0/171158866 wait complete. 2024-04-25T20:39:55.222 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-04-25T20:39:55.522 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:55 smithi195 ceph-mon[33250]: Deploying daemon mon.b on smithi112 2024-04-25T20:39:55.522 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:55 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/171158866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:39:55.522 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:55 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:55.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:55 smithi043 ceph-mon[29167]: Deploying daemon mon.b on smithi112 2024-04-25T20:39:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:55 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/171158866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:39:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:55 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:56.767 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T20:39:56.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T20:39:56.793 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:39:56 smithi195 ceph-mon[33250]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:39:56 smithi043 ceph-mon[29167]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:57.014 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:39:57.936 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:57 smithi112 podman[32302]: 2024-04-25 20:39:57.935747165 +0000 UTC m=+0.136173925 container create a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 podman[32302]: 2024-04-25 20:39:58.138210318 +0000 UTC m=+0.338637078 container init a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 podman[32302]: 2024-04-25 20:39:58.141533022 +0000 UTC m=+0.341959780 container start a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416) 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev), process ceph-mon, pid 2 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pidfile_write: ignore empty --pid-file 2024-04-25T20:39:58.190 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: load: jerasure load: lrc 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: RocksDB version: 7.9.2 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Git sha 0 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Compile date 2024-04-22 10:57:25 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: DB SUMMARY 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: DB Session ID: LLRP3YVU6LF2YRNN7L9V 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: CURRENT file: CURRENT 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-25T20:39:58.191 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.error_if_exists: 0 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.create_if_missing: 0 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.paranoid_checks: 1 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.env: 0x55ea25b83cc0 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.info_log: 0x55ea28325be0 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T20:39:58.192 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.statistics: (nil) 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.use_fsync: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_log_file_size: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_fallocate: 1 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.use_direct_reads: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.db_log_dir: 2024-04-25T20:39:58.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.wal_dir: 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.write_buffer_manager: 0x55ea282b90e0 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T20:39:58.194 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.unordered_write: 0 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.row_cache: None 2024-04-25T20:39:58.195 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.wal_filter: None 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.two_write_queues: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.wal_compression: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.atomic_flush: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T20:39:58.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.log_readahead_size: 0 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_background_jobs: 2 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_background_compactions: -1 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_subcompactions: 1 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T20:39:58.198 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_open_files: -1 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_background_flushes: -1 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Compression algorithms supported: 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kZSTD supported: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kXpressCompression supported: 0 2024-04-25T20:39:58.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kZlibCompression supported: 1 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kSnappyCompression supported: 1 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kLZ4Compression supported: 1 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: kBZip2Compression supported: 0 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.merge_operator: 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_filter: None 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T20:39:58.200 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ea28325dc0) 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_type: 0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: data_block_index_type: 0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_shortening: 1 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: checksum: 4 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: no_block_cache: 0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache: 0x55ea282eb1f0 2024-04-25T20:39:58.201 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_options: 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: capacity : 536870912 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: num_shard_bits : 4 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: strict_capacity_limit : 0 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_compressed: (nil) 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: persistent_cache: (nil) 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_size: 4096 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_size_deviation: 10 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_restart_interval: 16 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_block_restart_interval: 1 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: metadata_block_size: 4096 2024-04-25T20:39:58.202 INFO:journalctl@ceph.mon.b.smithi112.stdout: partition_filters: 0 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: use_delta_encoding: 1 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: filter_policy: bloomfilter 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: whole_key_filtering: 1 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: verify_compression: 0 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: format_version: 5 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: enable_index_compression: 1 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_align: 0 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: max_auto_readahead_size: 262144 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: prepopulate_block_cache: 0 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: initial_auto_readahead_size: 8192 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T20:39:58.203 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression: NoCompression 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.num_levels: 7 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T20:39:58.204 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T20:39:58.205 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T20:39:58.206 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.inplace_update_support: 0 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T20:39:58.207 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.bloom_locality: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.max_successive_merges: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.ttl: 2592000 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enable_blob_files: false 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.min_blob_size: 0 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T20:39:58.208 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bce87580-51ff-4a6d-9d2a-a3e4b8a210cf 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077598171235, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077598171640, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714077598, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bce87580-51ff-4a6d-9d2a-a3e4b8a210cf", "db_session_id": "LLRP3YVU6LF2YRNN7L9V", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714077598171720, "job": 1, "event": "recovery_finished"} 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T20:39:58.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ea28400000 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: DB pointer 0x55ea283ea000 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** DB Stats ** 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.210 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** Compaction Stats [default] ** 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T20:39:58.211 INFO:journalctl@ceph.mon.b.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: Block cache BinnedLRUCache@0x55ea282eb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: using public_addr v2:172.21.15.112:0/0 -> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: starting mon.b rank -1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(???) e0 preinit fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:58.212 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).mds e1 new map 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: e1 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: legacy client fscid: -1 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout: No filesystems configured 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T20:39:58.213 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:58.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Deploying cephadm binary to smithi195 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Added host smithi195 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3976772425' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3976772425' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:39:58.216 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Saving service mon spec with placement smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c;count:3 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Deploying daemon mon.c on smithi195 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/537874771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.a calling monitor election 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.c calling monitor election 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T20:39:58.218 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: monmap epoch 2 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: last_changed 2024-04-25T20:39:49.340489+0000 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: min_mon_release 19 (squid) 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: election_strategy: 1 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: fsmap 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mgrmap e13: x(active, since 49s) 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: overall HEALTH_OK 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:39:58.219 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:39:58.220 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: Deploying daemon mon.b on smithi112 2024-04-25T20:39:58.220 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/171158866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:39:58.220 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:39:58.220 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:39:58.220 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 ceph-mon[32322]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T20:39:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 bash[32302]: a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab 2024-04-25T20:39:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:39:58 smithi112 systemd[1]: Started Ceph mon.b for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:40:03.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:40:03.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:40:03.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: mon.a calling monitor election 2024-04-25T20:40:03.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: mon.c calling monitor election 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: mon.b calling monitor election 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: monmap epoch 3 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: last_changed 2024-04-25T20:39:58.194478+0000 2024-04-25T20:40:03.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: min_mon_release 19 (squid) 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: election_strategy: 1 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: fsmap 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: mgrmap e13: x(active, since 58s) 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: overall HEALTH_OK 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.547 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: mon.a calling monitor election 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: mon.c calling monitor election 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: mon.b calling monitor election 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: monmap epoch 3 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: last_changed 2024-04-25T20:39:58.194478+0000 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: min_mon_release 19 (squid) 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: election_strategy: 1 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: fsmap 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: mgrmap e13: x(active, since 58s) 2024-04-25T20:40:03.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: overall HEALTH_OK 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: mon.a calling monitor election 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: mon.c calling monitor election 2024-04-25T20:40:03.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: mon.b calling monitor election 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: monmap epoch 3 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: last_changed 2024-04-25T20:39:58.194478+0000 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: created 2024-04-25T20:37:56.803474+0000 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: min_mon_release 19 (squid) 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: election_strategy: 1 2024-04-25T20:40:03.595 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: 0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: 1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.c 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: fsmap 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: mgrmap e13: x(active, since 58s) 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: overall HEALTH_OK 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:03.596 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- 172.21.15.195:0/4229954967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fd0006230 msgr2=0x7f0fd00086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 --2- 172.21.15.195:0/4229954967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fd0006230 0x7f0fd00086a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fe406aeb0 tx=0x7f0fe000fe90 comp rx=0 tx=0).stop 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- 172.21.15.195:0/4229954967 shutdown_connections 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 --2- 172.21.15.195:0/4229954967 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fd0006230 0x7f0fd00086a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- 172.21.15.195:0/4229954967 >> 172.21.15.195:0/4229954967 conn(0x7f0fe40fcf80 msgr2=0x7f0fe40ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- 172.21.15.195:0/4229954967 shutdown_connections 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- 172.21.15.195:0/4229954967 wait complete. 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 Processor -- start 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.385+0000 7f0febbdc700 1 -- start start 2024-04-25T20:40:04.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 0x7f0fe4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe41a4560 0x7f0fe41a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe410a580 con 0x7f0fe41a4560 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe410a400 con 0x7f0fd0006230 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe410a700 con 0x7f0fe41018b0 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:49552/0 (socket says 172.21.15.195:49552) 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 -- 172.21.15.195:0/3100322533 learned_addr learned my addr 172.21.15.195:0/3100322533 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9978700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 0x7f0fe4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fea179700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe41a4560 0x7f0fe41a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 -- 172.21.15.195:0/3100322533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 msgr2=0x7f0fe4101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:04.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 0x7f0fe4101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 -- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe41a4560 msgr2=0x7f0fe41a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe41a4560 0x7f0fe41a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 -- 172.21.15.195:0/3100322533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe41a7080 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9978700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 0x7f0fe4101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fe9177700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400b780 tx=0x7f0fd400bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4004230 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0fd40043d0 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe41a7370 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4011c30 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.386+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe41a78b0 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.387+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f0fd401a400 con 0x7f0fe41018b0 2024-04-25T20:40:04.391 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.387+0000 7f0fdaffd700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 0x7f0fc803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:04.392 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.387+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0fd404c5d0 con 0x7f0fe41018b0 2024-04-25T20:40:04.392 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.387+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe40640a0 con 0x7f0fe41018b0 2024-04-25T20:40:04.392 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.388+0000 7f0fe9978700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 0x7f0fc803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:04.392 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.388+0000 7f0fe9978700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 0x7f0fc803bfa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000fa40 tx=0x7f0fe0005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:04.394 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.393+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0fd4018750 con 0x7f0fe41018b0 2024-04-25T20:40:04.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:04 smithi043 ceph-mon[29167]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:04.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:04.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:04.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:04 smithi195 ceph-mon[33250]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:04.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:04.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:04.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:04 smithi112 ceph-mon[32322]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:04.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:04.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:40:04.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.699+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0fe402df80 con 0x7f0fe41018b0 2024-04-25T20:40:04.699 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.699+0000 7f0fdaffd700 1 -- 172.21.15.195:0/3100322533 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f0fd4003c90 con 0x7f0fe41018b0 2024-04-25T20:40:04.699 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-25T20:40:04.700 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","modified":"2024-04-25T20:39:58.194478Z","created":"2024-04-25T20:37:56.803474Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:3300","nonce":0},{"type":"v1","addr":"172.21.15.43:6789","nonce":0}]},"addr":"172.21.15.43:6789/0","public_addr":"172.21.15.43:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-25T20:40:04.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 msgr2=0x7f0fc803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:04.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 0x7f0fc803bfa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000fa40 tx=0x7f0fe0005a90 comp rx=0 tx=0).stop 2024-04-25T20:40:04.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 msgr2=0x7f0fe4101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400b780 tx=0x7f0fd400bb40 comp rx=0 tx=0).stop 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 shutdown_connections 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0fc8039ae0 0x7f0fc803bfa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fe41a4560 0x7f0fe41a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0fd0006230 0x7f0fe4101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 --2- 172.21.15.195:0/3100322533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fe41018b0 0x7f0fe4101d30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 >> 172.21.15.195:0/3100322533 conn(0x7f0fe40fcf80 msgr2=0x7f0fe4107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.701+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 shutdown_connections 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:04.702+0000 7f0febbdc700 1 -- 172.21.15.195:0/3100322533 wait complete. 2024-04-25T20:40:04.703 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2024-04-25T20:40:05.362 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T20:40:05.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T20:40:05.617 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:40:05.635 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/3100322533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.636 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:05.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T20:40:05.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:05.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:05.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:05.637 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:05 smithi043 ceph-mon[29167]: Reconfiguring daemon mon.a on smithi043 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:40:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/3100322533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:05 smithi195 ceph-mon[33250]: Reconfiguring daemon mon.a on smithi043 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/3100322533' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:06.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:05 smithi112 ceph-mon[32322]: Reconfiguring daemon mon.a on smithi043 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 -- 172.21.15.43:0/2379393595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 msgr2=0x7fc72010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 --2- 172.21.15.43:0/2379393595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc72010f930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b0a0 tx=0x7fc71800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 -- 172.21.15.43:0/2379393595 shutdown_connections 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 --2- 172.21.15.43:0/2379393595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc720108a60 0x7fc720108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 --2- 172.21.15.43:0/2379393595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc72010f930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 --2- 172.21.15.43:0/2379393595 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc72006b1f0 0x7fc72006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 -- 172.21.15.43:0/2379393595 >> 172.21.15.43:0/2379393595 conn(0x7fc7200789e0 msgr2=0x7fc720078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 -- 172.21.15.43:0/2379393595 shutdown_connections 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.082+0000 7fc725ebd700 1 -- 172.21.15.43:0/2379393595 wait complete. 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 Processor -- start 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 -- start start 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc72006b1f0 0x7fc720199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc720108a60 0x7fc72019db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc720112e10 con 0x7fc72006bbb0 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc720112c90 con 0x7fc720108a60 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc725ebd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc720112f90 con 0x7fc72006b1f0 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:08.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40316/0 (socket says 172.21.15.43:40316) 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 -- 172.21.15.43:0/467536699 learned_addr learned my addr 172.21.15.43:0/467536699 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71f7fe700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc72006b1f0 0x7fc720199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71ffff700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc720108a60 0x7fc72019db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 -- 172.21.15.43:0/467536699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc72006b1f0 msgr2=0x7fc720199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc72006b1f0 0x7fc720199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 -- 172.21.15.43:0/467536699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc720108a60 msgr2=0x7fc72019db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc720108a60 0x7fc72019db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.083+0000 7fc71effd700 1 -- 172.21.15.43:0/467536699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72019e250 con 0x7fc72006bbb0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc71effd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc71400b530 tx=0x7fc71400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714015020 con 0x7fc72006bbb0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72019e540 con 0x7fc72006bbb0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc714011d00 con 0x7fc72006bbb0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714010e60 con 0x7fc72006bbb0 2024-04-25T20:40:08.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.084+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7201a5dc0 con 0x7fc72006bbb0 2024-04-25T20:40:08.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fc714018020 con 0x7fc72006bbb0 2024-04-25T20:40:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720069730 con 0x7fc72006bbb0 2024-04-25T20:40:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc71cff9700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 0x7fc70803bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc71404c2f0 con 0x7fc72006bbb0 2024-04-25T20:40:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc71f7fe700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 0x7fc70803bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.085+0000 7fc71f7fe700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 0x7fc70803bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc710005ea0 tx=0x7fc710005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:08.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.090+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc71401f020 con 0x7fc72006bbb0 2024-04-25T20:40:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.300+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc72002df80 con 0x7fc72006bbb0 2024-04-25T20:40:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.300+0000 7fc71cff9700 1 -- 172.21.15.43:0/467536699 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fc71401a400 con 0x7fc72006bbb0 2024-04-25T20:40:08.302 INFO:teuthology.orchestra.run.smithi043.stdout:# minimal ceph.conf for 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:40:08.302 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-25T20:40:08.302 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:40:08.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon_host = [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-04-25T20:40:08.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 msgr2=0x7fc70803bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 0x7fc70803bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc710005ea0 tx=0x7fc710005e30 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 msgr2=0x7fc720199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc71400b530 tx=0x7fc71400b8f0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 shutdown_connections 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc708039890 0x7fc70803bd50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc72006b1f0 0x7fc720199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc720108a60 0x7fc72019db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 --2- 172.21.15.43:0/467536699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc72006bbb0 0x7fc720199780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 >> 172.21.15.43:0/467536699 conn(0x7fc7200789e0 msgr2=0x7fc7200ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 shutdown_connections 2024-04-25T20:40:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:08.303+0000 7fc725ebd700 1 -- 172.21.15.43:0/467536699 wait complete. 2024-04-25T20:40:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: Reconfiguring mon.b (monmap changed)... 2024-04-25T20:40:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:08 smithi112 ceph-mon[32322]: Reconfiguring daemon mon.b on smithi112 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: Reconfiguring mon.b (monmap changed)... 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:08.490 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:08 smithi043 ceph-mon[29167]: Reconfiguring daemon mon.b on smithi112 2024-04-25T20:40:08.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: Reconfiguring mon.b (monmap changed)... 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:08 smithi195 ceph-mon[33250]: Reconfiguring daemon mon.b on smithi112 2024-04-25T20:40:08.887 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T20:40:08.887 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:40:08.887 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T20:40:08.915 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:40:08.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:40:08.979 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:40:08.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T20:40:09.007 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:40:09.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:40:09.072 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:40:09.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T20:40:09.098 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:40:09.098 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:40:09.161 INFO:tasks.cephadm:Adding mgr.x on smithi043 2024-04-25T20:40:09.161 INFO:tasks.cephadm:Adding mgr.y on smithi112 2024-04-25T20:40:09.162 INFO:tasks.cephadm:Adding mgr.z on smithi195 2024-04-25T20:40:09.162 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi043=x;smithi112=y;smithi195=z' 2024-04-25T20:40:09.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/467536699' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:09.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:09.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:09.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:09.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/467536699' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:09.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:09.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/467536699' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:09.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:09.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T20:40:09.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T20:40:09.474 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:10.243 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:40:10.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:10 smithi043 ceph-mon[29167]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:10.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:10 smithi043 ceph-mon[29167]: Reconfiguring mon.c (monmap changed)... 2024-04-25T20:40:10.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:10 smithi043 ceph-mon[29167]: Reconfiguring daemon mon.c on smithi195 2024-04-25T20:40:10.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:10 smithi195 ceph-mon[33250]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:10.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:10 smithi195 ceph-mon[33250]: Reconfiguring mon.c (monmap changed)... 2024-04-25T20:40:10.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:10 smithi195 ceph-mon[33250]: Reconfiguring daemon mon.c on smithi195 2024-04-25T20:40:10.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:10 smithi112 ceph-mon[32322]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:10.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:10 smithi112 ceph-mon[32322]: Reconfiguring mon.c (monmap changed)... 2024-04-25T20:40:10.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:10 smithi112 ceph-mon[32322]: Reconfiguring daemon mon.c on smithi195 2024-04-25T20:40:11.548 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.548 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:11.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:11.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:11.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- 172.21.15.195:0/274675676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850102aa0 msgr2=0x7f3850102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- 172.21.15.195:0/274675676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850102aa0 0x7f3850102ec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f384c009990 tx=0x7f384c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- 172.21.15.195:0/274675676 shutdown_connections 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- 172.21.15.195:0/274675676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850102aa0 0x7f3850102ec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- 172.21.15.195:0/274675676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3850104640 0x7f385010aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.762 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- 172.21.15.195:0/274675676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850103ca0 0x7f3850104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- 172.21.15.195:0/274675676 >> 172.21.15.195:0/274675676 conn(0x7f38500fe040 msgr2=0x7f3850100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- 172.21.15.195:0/274675676 shutdown_connections 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- 172.21.15.195:0/274675676 wait complete. 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 Processor -- start 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- start start 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850102aa0 0x7f3850198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:11.763 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3850104640 0x7f38501a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.758+0000 7f38572fe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f385010e650 con 0x7f3850104640 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38572fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f385010e4d0 con 0x7f3850102aa0 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38572fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f385010e7d0 con 0x7f3850103ca0 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:46244/0 (socket says 172.21.15.195:46244) 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 -- 172.21.15.195:0/1948869831 learned_addr learned my addr 172.21.15.195:0/1948869831 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f385509a700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850102aa0 0x7f3850198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:11.764 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 -- 172.21.15.195:0/1948869831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850102aa0 msgr2=0x7f3850198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850102aa0 0x7f3850198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 -- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3850104640 msgr2=0x7f38501a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3850104640 0x7f38501a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 -- 172.21.15.195:0/1948869831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38501a0970 con 0x7f3850103ca0 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f3854899700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f384000d950 tx=0x7f384000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:11.765 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840016070 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38501a0c60 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3840009e10 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384000f620 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.759+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38501a11a0 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.760+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3850069730 con 0x7f3850103ca0 2024-04-25T20:40:11.766 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.760+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3840019070 con 0x7f3850103ca0 2024-04-25T20:40:11.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.761+0000 7f38467fc700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 0x7f383c03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:11.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.761+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f384004c570 con 0x7f3850103ca0 2024-04-25T20:40:11.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.761+0000 7f385509a700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 0x7f383c03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:11.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.761+0000 7f385509a700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 0x7f383c03bd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f385019a200 tx=0x7f384c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:11.768 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.766+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3840022300 con 0x7f3850103ca0 2024-04-25T20:40:11.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:11.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.975+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi112=y;smithi195=z", "target": ["mon-mgr", ""]}) -- 0x7f3850062f10 con 0x7f383c039890 2024-04-25T20:40:11.981 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.981+0000 7f38467fc700 1 -- 172.21.15.195:0/1948869831 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3850062f10 con 0x7f383c039890 2024-04-25T20:40:11.982 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 msgr2=0x7f383c03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 0x7f383c03bd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f385019a200 tx=0x7f384c005fd0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 msgr2=0x7f3850199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f384000d950 tx=0x7f384000dc60 comp rx=0 tx=0).stop 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 shutdown_connections 2024-04-25T20:40:11.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f383c039890 0x7f383c03bd50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3850104640 0x7f38501a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3850102aa0 0x7f3850198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 --2- 172.21.15.195:0/1948869831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3850103ca0 0x7f3850199260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 >> 172.21.15.195:0/1948869831 conn(0x7f38500fe040 msgr2=0x7f3850106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 shutdown_connections 2024-04-25T20:40:11.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:40:11.984+0000 7f38572fe700 1 -- 172.21.15.195:0/1948869831 wait complete. 2024-04-25T20:40:12.560 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:12.561 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:12.562 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.590 DEBUG:teuthology.orchestra.run.smithi112:mgr.y> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.y.service 2024-04-25T20:40:12.593 DEBUG:teuthology.orchestra.run.smithi195:mgr.z> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.z.service 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:12.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.596 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T20:40:12.597 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:40:12.597 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T20:40:12.616 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T20:40:12.616 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 20:39:17.899082776 +0000 2024-04-25T20:40:12.674 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 20:34:32.786355293 +0000 2024-04-25T20:40:12.675 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 20:34:32.786355293 +0000 2024-04-25T20:40:12.675 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 20:34:32.786355293 +0000 2024-04-25T20:40:12.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T20:40:12.738 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:12.738 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:12.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T20:40:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T20:40:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000125401 s, 4.1 MB/s 2024-04-25T20:40:12.743 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T20:40:12.802 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-04-25T20:40:12.859 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 20:39:17.934082310 +0000 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 20:34:33.127350576 +0000 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 20:34:33.127350576 +0000 2024-04-25T20:40:12.860 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 20:34:33.127350576 +0000 2024-04-25T20:40:12.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T20:40:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T20:40:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T20:40:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00012954 s, 4.0 MB/s 2024-04-25T20:40:12.929 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T20:40:12.988 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-04-25T20:40:13.046 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T20:40:13.046 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 20:39:17.968081857 +0000 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 20:34:33.459345982 +0000 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 20:34:33.459345982 +0000 2024-04-25T20:40:13.047 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 20:34:33.459345982 +0000 2024-04-25T20:40:13.047 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T20:40:13.114 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T20:40:13.114 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T20:40:13.114 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000139679 s, 3.7 MB/s 2024-04-25T20:40:13.115 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T20:40:13.174 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-04-25T20:40:13.232 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T20:40:13.232 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.232 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T20:40:13.232 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.232 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.233 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 20:39:18.002081404 +0000 2024-04-25T20:40:13.233 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 20:34:33.810341126 +0000 2024-04-25T20:40:13.233 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 20:34:33.810341126 +0000 2024-04-25T20:40:13.233 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 20:34:33.810341126 +0000 2024-04-25T20:40:13.233 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T20:40:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-04-25T20:40:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-04-25T20:40:13.299 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000125865 s, 4.1 MB/s 2024-04-25T20:40:13.301 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T20:40:13.360 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-25T20:40:13.360 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T20:40:13.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T20:40:13.379 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-25T20:40:13.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:13 smithi195 ceph-mon[33250]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi112=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:13.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:13 smithi195 ceph-mon[33250]: Saving service mgr spec with placement smithi043=x;smithi112=y;smithi195=z;count:3 2024-04-25T20:40:13.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:13 smithi195 ceph-mon[33250]: Deploying daemon mgr.z on smithi195 2024-04-25T20:40:13.436 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T20:40:13.436 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 20:39:57.605944426 +0000 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 20:34:44.232271859 +0000 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 20:34:44.232271859 +0000 2024-04-25T20:40:13.437 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 20:34:44.232271859 +0000 2024-04-25T20:40:13.437 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T20:40:13.502 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T20:40:13.503 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T20:40:13.503 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000283287 s, 1.8 MB/s 2024-04-25T20:40:13.504 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T20:40:13.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:13 smithi043 ceph-mon[29167]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi112=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:13.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:13 smithi043 ceph-mon[29167]: Saving service mgr spec with placement smithi043=x;smithi112=y;smithi195=z;count:3 2024-04-25T20:40:13.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:13 smithi043 ceph-mon[29167]: Deploying daemon mgr.z on smithi195 2024-04-25T20:40:13.562 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-25T20:40:13.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:13 smithi112 ceph-mon[32322]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi043=x;smithi112=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:13.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:13 smithi112 ceph-mon[32322]: Saving service mgr spec with placement smithi043=x;smithi112=y;smithi195=z;count:3 2024-04-25T20:40:13.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:13 smithi112 ceph-mon[32322]: Deploying daemon mgr.z on smithi195 2024-04-25T20:40:13.607 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T20:40:13.607 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 20:39:57.606944400 +0000 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 20:34:44.566262912 +0000 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 20:34:44.566262912 +0000 2024-04-25T20:40:13.608 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 20:34:44.566262912 +0000 2024-04-25T20:40:13.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T20:40:13.672 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T20:40:13.672 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T20:40:13.672 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000207285 s, 2.5 MB/s 2024-04-25T20:40:13.673 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T20:40:13.730 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.786 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 20:39:57.606944400 +0000 2024-04-25T20:40:13.787 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 20:34:44.907253778 +0000 2024-04-25T20:40:13.787 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 20:34:44.907253778 +0000 2024-04-25T20:40:13.787 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 20:34:44.907253778 +0000 2024-04-25T20:40:13.787 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T20:40:13.850 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T20:40:13.850 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T20:40:13.850 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000234771 s, 2.2 MB/s 2024-04-25T20:40:13.851 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T20:40:13.908 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-25 20:39:57.607944374 +0000 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-25 20:34:45.231245099 +0000 2024-04-25T20:40:13.964 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-25 20:34:45.231245099 +0000 2024-04-25T20:40:13.965 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-04-25 20:34:45.231245099 +0000 2024-04-25T20:40:13.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T20:40:14.026 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-25T20:40:14.027 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-25T20:40:14.027 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000243276 s, 2.1 MB/s 2024-04-25T20:40:14.028 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T20:40:14.084 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-25T20:40:14.084 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T20:40:14.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T20:40:14.100 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-25T20:40:14.155 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T20:40:14.155 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:14.155 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T20:40:14.155 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:14.156 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:14.156 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 20:40:14.024037765 +0000 2024-04-25T20:40:14.156 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 20:35:02.344518786 +0000 2024-04-25T20:40:14.156 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 20:35:02.344518786 +0000 2024-04-25T20:40:14.156 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 20:35:02.344518786 +0000 2024-04-25T20:40:14.156 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T20:40:14.222 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T20:40:14.222 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T20:40:14.222 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.627e-05 s, 5.9 MB/s 2024-04-25T20:40:14.223 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T20:40:14.279 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 20:40:14.024037765 +0000 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 20:35:02.662512818 +0000 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 20:35:02.662512818 +0000 2024-04-25T20:40:14.335 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 20:35:02.662512818 +0000 2024-04-25T20:40:14.336 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T20:40:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:14 smithi195 ceph-mon[33250]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:14.365 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T20:40:14.365 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T20:40:14.365 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.3417e-05 s, 5.5 MB/s 2024-04-25T20:40:14.366 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T20:40:14.422 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-25T20:40:14.476 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T20:40:14.476 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T20:40:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 20:40:14.025037747 +0000 2024-04-25T20:40:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 20:35:02.982506812 +0000 2024-04-25T20:40:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 20:35:02.982506812 +0000 2024-04-25T20:40:14.477 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 20:35:02.982506812 +0000 2024-04-25T20:40:14.477 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T20:40:14.539 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T20:40:14.540 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T20:40:14.540 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.1196e-05 s, 5.6 MB/s 2024-04-25T20:40:14.541 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T20:40:14.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:14 smithi112 ceph-mon[32322]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:14.596 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-25T20:40:14.650 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-25 20:40:14.025037747 +0000 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-25 20:35:03.305500750 +0000 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-25 20:35:03.305500750 +0000 2024-04-25T20:40:14.651 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-25 20:35:03.305500750 +0000 2024-04-25T20:40:14.651 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T20:40:14.716 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-25T20:40:14.716 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-25T20:40:14.716 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.6664e-05 s, 5.3 MB/s 2024-04-25T20:40:14.717 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T20:40:14.775 INFO:tasks.cephadm:Deploying osd.0 on smithi043 with /dev/vg_nvme/lv_4... 2024-04-25T20:40:14.776 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T20:40:14.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:14 smithi043 ceph-mon[29167]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:14.959 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:14.768+0000 7fcab850d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:40:14.959 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:14.959+0000 7fcab850d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:40:15.028 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:40:15.320 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:15.063+0000 7fcab850d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:40:15.591 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:15.384+0000 7fcab850d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:40:15.592 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:15.468+0000 7fcab850d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:40:15.960 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:15.960 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:15.960 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:15.960 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:15.960 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:15.961 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:15.961 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:15.961 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:15.961 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:15 smithi112 ceph-mon[32322]: Deploying daemon mgr.y on smithi112 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:15 smithi043 ceph-mon[29167]: Deploying daemon mgr.y on smithi112 2024-04-25T20:40:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:15 smithi195 ceph-mon[33250]: Deploying daemon mgr.y on smithi112 2024-04-25T20:40:16.785 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T20:40:16.786 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T20:40:16.786 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T20:40:16.786 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T20:40:16.786 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00847285 s, 1.2 GB/s 2024-04-25T20:40:16.786 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T20:40:17.006 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:16.664+0000 7fcab850d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:40:17.007 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:16.833+0000 7fcab850d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:40:17.007 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:17.005+0000 7fcab850d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:40:17.221 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 podman[33733]: 2024-04-25 20:40:17.19588742 +0000 UTC m=+0.341310684 container start 5f4c642dcf0f613b3641703915cac182742274400ab823770a8e80e269b9108b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:40:17.221 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 ceph-mgr[33752]: -- 172.21.15.112:0/1919691720 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561add5945a0 con 0x561add569000 2024-04-25T20:40:17.348 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_4 2024-04-25T20:40:17.537 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 bash[33733]: 5f4c642dcf0f613b3641703915cac182742274400ab823770a8e80e269b9108b 2024-04-25T20:40:17.537 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 systemd[1]: Started Ceph mgr.y for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:40:17.537 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:17.342+0000 7fab400b4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:40:17.538 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:17.536+0000 7fab400b4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:40:17.590 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:17.291+0000 7fcab850d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:40:17.590 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:17.381+0000 7fcab850d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:40:17.590 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:17.588+0000 7fcab850d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:40:17.637 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:40:17.842 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:17.787+0000 7fcab850d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:40:17.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:17.639+0000 7fab400b4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:40:18.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:17.967+0000 7fab400b4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:40:18.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:18.053+0000 7fab400b4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:40:18.673 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:18.418+0000 7fcab850d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:40:18.673 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:18.673 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.674 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.674 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.674 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.674 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.776 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:18.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:18.961 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:18.846+0000 7fcab850d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.143+0000 7f3778e7a700 1 -- 172.21.15.43:0/2857936375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774104660 msgr2=0x7f377410af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.143+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2857936375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774104660 0x7f377410af10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b0d0 tx=0x7f376c00b3e0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 -- 172.21.15.43:0/2857936375 shutdown_connections 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2857936375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774104660 0x7f377410af10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2857936375 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774102ac0 0x7f3774102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2857936375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774103cc0 0x7f3774104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 -- 172.21.15.43:0/2857936375 >> 172.21.15.43:0/2857936375 conn(0x7f37740fe060 msgr2=0x7f37741004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 -- 172.21.15.43:0/2857936375 shutdown_connections 2024-04-25T20:40:19.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.144+0000 7f3778e7a700 1 -- 172.21.15.43:0/2857936375 wait complete. 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 Processor -- start 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 -- start start 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 0x7f3774198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774104660 0x7f37741a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f377410e6f0 con 0x7f3774103cc0 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f377410e570 con 0x7f3774104660 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3778e7a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f377410e870 con 0x7f3774102ac0 2024-04-25T20:40:19.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f377259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 0x7f3774198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46532/0 (socket says 172.21.15.43:46532) 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f377259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 0x7f3774198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:60404/0 (socket says 172.21.15.43:60404) 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 -- 172.21.15.43:0/2529659159 learned_addr learned my addr 172.21.15.43:0/2529659159 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3772d9d700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774104660 0x7f37741a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 -- 172.21.15.43:0/2529659159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 msgr2=0x7f3774198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 0x7f3774198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 -- 172.21.15.43:0/2529659159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774104660 msgr2=0x7f37741a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774104660 0x7f37741a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 -- 172.21.15.43:0/2529659159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37741a0960 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.145+0000 7f3771d9b700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f376800e9c0 tx=0x7f376800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.146+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376800cbd0 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.146+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f376800ee60 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.146+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768005670 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.146+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37741a0c50 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.146+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37741a1190 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f3768021440 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3774069730 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f37637fe700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 0x7f375c03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f376804cb90 con 0x7f3774103cc0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f377259c700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 0x7f375c03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:19.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.147+0000 7f377259c700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 0x7f375c03bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f377419a1f0 tx=0x7f3764007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:19.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.152+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3768021730 con 0x7f3774103cc0 2024-04-25T20:40:19.342 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:18.960+0000 7fcab850d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:40:19.342 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:19.162+0000 7fcab850d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:40:19.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:19.373+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3774062e80 con 0x7f375c039890 2024-04-25T20:40:19.592 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:19.297+0000 7fab400b4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:40:19.593 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:19.465+0000 7fab400b4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:40:19.921 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:19.633+0000 7fab400b4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:40:19.921 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:19.920+0000 7fab400b4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:40:19.955 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:19.682+0000 7fcab850d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:40:19.955 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:19.773+0000 7fcab850d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T20:40:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.213 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:20.012+0000 7fab400b4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:40:20.213 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:20.212+0000 7fab400b4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:20.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.215 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:20.015+0000 7fcab850d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:20.147+0000 7fcab850d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:20.242+0000 7fcab850d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.244 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: Reconfiguring daemon mgr.x on smithi043 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:20.245 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:20.592 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:20.356+0000 7fcab850d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:40:20.592 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:20.402+0000 7fab400b4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:40:21.091 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:20.673+0000 7fcab850d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:40:21.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:20.998+0000 7fab400b4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:40:21.591 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:21.271+0000 7fcab850d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:40:21.592 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:40:21.483+0000 7fcab850d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:40:21.710 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:21.415+0000 7fab400b4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:40:21.710 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:21.510+0000 7fab400b4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:40:21.710 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:21.709+0000 7fab400b4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:40:21.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:21.961+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7f3768020ca0 con 0x7f3774103cc0 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: Standby manager daemon z started 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:40:22.090 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:22.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:40:22.091 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:21 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: Standby manager daemon z started 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:40:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:21 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: Standby manager daemon z started 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:40:22.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:21 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/1215428312' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:22.562 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.228+0000 7fab400b4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:40:22.563 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.319+0000 7fab400b4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:40:22.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.561+0000 7fab400b4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:40:22.843 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.693+0000 7fab400b4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:40:22.843 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.787+0000 7fab400b4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:40:23.202 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-mon[32322]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T20:40:23.202 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:40:23.202 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:22.902+0000 7fab400b4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:40:23.202 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:23.201+0000 7fab400b4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:40:23.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:22 smithi043 ceph-mon[29167]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T20:40:23.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:22 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:40:23.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:22 smithi195 ceph-mon[33250]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-25T20:40:23.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:22 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:23.795+0000 7fab400b4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:40:24.009+0000 7fab400b4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]: dispatch 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]': finished 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:24.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:23 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1093655669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]: dispatch 2024-04-25T20:40:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]': finished 2024-04-25T20:40:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T20:40:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:24.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:23 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1093655669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]: dispatch 2024-04-25T20:40:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2555977597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4c56ba7-7f1c-4efe-b163-b34e794c2af2"}]': finished 2024-04-25T20:40:24.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T20:40:24.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:24.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:23 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1093655669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:24.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:24.977+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f37680107b0 con 0x7f3774103cc0 2024-04-25T20:40:25.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:24 smithi043 ceph-mon[29167]: Standby manager daemon y started 2024-04-25T20:40:25.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:24 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:40:25.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:24 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:25.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:24 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:40:25.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:24 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:25.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:24 smithi195 ceph-mon[33250]: Standby manager daemon y started 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:24 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:24 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:24 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:24 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-mon[32322]: Standby manager daemon y started 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:40:25.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:40:25.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:24 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/679679129' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:40:26.227 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:25 smithi112 ceph-mon[32322]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:26.227 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:25 smithi112 ceph-mon[32322]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T20:40:26.227 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:25 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:40:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:25 smithi043 ceph-mon[29167]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:25 smithi043 ceph-mon[29167]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T20:40:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:25 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:40:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:25 smithi195 ceph-mon[33250]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:25 smithi195 ceph-mon[33250]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-25T20:40:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:25 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:40:28.143 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:27 smithi043 ceph-mon[29167]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:27 smithi195 ceph-mon[33250]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:27 smithi112 ceph-mon[32322]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:30.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:29 smithi043 ceph-mon[29167]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:29 smithi195 ceph-mon[33250]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:29 smithi112 ceph-mon[32322]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:31.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T20:40:31.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:31.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:30 smithi043 ceph-mon[29167]: Deploying daemon osd.0 on smithi043 2024-04-25T20:40:31.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T20:40:31.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:31.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:30 smithi195 ceph-mon[33250]: Deploying daemon osd.0 on smithi043 2024-04-25T20:40:31.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T20:40:31.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:31.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:30 smithi112 ceph-mon[32322]: Deploying daemon osd.0 on smithi043 2024-04-25T20:40:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:31 smithi043 ceph-mon[29167]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:31 smithi195 ceph-mon[33250]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:31 smithi112 ceph-mon[32322]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:34.111 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:33 smithi043 ceph-mon[29167]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:33 smithi195 ceph-mon[33250]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:33 smithi112 ceph-mon[32322]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:36.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:35 smithi043 ceph-mon[29167]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:35 smithi195 ceph-mon[33250]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:35 smithi112 ceph-mon[32322]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:38.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:37 smithi043 ceph-mon[29167]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:37 smithi195 ceph-mon[33250]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:37 smithi112 ceph-mon[32322]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:39.531 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 0 on host 'smithi043' 2024-04-25T20:40:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.529+0000 7f37637fe700 1 -- 172.21.15.43:0/2529659159 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3774062e80 con 0x7f375c039890 2024-04-25T20:40:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 msgr2=0x7f375c03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 0x7f375c03bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f377419a1f0 tx=0x7f3764007400 comp rx=0 tx=0).stop 2024-04-25T20:40:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 msgr2=0x7f3774199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f376800e9c0 tx=0x7f376800ecd0 comp rx=0 tx=0).stop 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 shutdown_connections 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f375c039890 0x7f375c03bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3774102ac0 0x7f3774198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3774104660 0x7f37741a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 --2- 172.21.15.43:0/2529659159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3774103cc0 0x7f3774199250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.533+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 >> 172.21.15.43:0/2529659159 conn(0x7f37740fe060 msgr2=0x7f3774106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.534+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 shutdown_connections 2024-04-25T20:40:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:40:39.534+0000 7f3778e7a700 1 -- 172.21.15.43:0/2529659159 wait complete. 2024-04-25T20:40:39.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:39.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:40:40.209 DEBUG:teuthology.orchestra.run.smithi043:osd.0> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T20:40:40.211 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_4... 2024-04-25T20:40:40.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T20:40:40.451 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:40:40.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:40 smithi043 ceph-mon[29167]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T20:40:40.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:40 smithi195 ceph-mon[33250]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T20:40:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:40 smithi112 ceph-mon[32322]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T20:40:41.645 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:41 smithi043 ceph-mon[29167]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T20:40:41.645 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:41 smithi043 ceph-mon[29167]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T20:40:41.645 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:41 smithi043 ceph-mon[29167]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:40:41.645 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:41 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:41.646 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:41 smithi043 ceph-mon[29167]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:41.691 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:41 smithi112 ceph-mon[32322]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T20:40:41.691 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:41 smithi112 ceph-mon[32322]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T20:40:41.691 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:41 smithi112 ceph-mon[32322]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:40:41.691 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:41 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:41.691 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:41 smithi112 ceph-mon[32322]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:41.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:41 smithi195 ceph-mon[33250]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T20:40:41.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:41 smithi195 ceph-mon[33250]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T20:40:41.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:41 smithi195 ceph-mon[33250]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:40:41.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:41 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:41.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:41 smithi195 ceph-mon[33250]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126419 s, 829 MB/s 2024-04-25T20:40:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T20:40:42.478 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0[44374]: 2024-04-25T20:40:42.089+0000 7f9812fc3700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T20:40:42.478 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0[44374]: 2024-04-25T20:40:42.093+0000 7f980adae700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:40:42.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-mon[29167]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:40:42.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-mon[29167]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T20:40:42.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:42 smithi043 ceph-mon[29167]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:42 smithi195 ceph-mon[33250]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:42 smithi195 ceph-mon[33250]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:42 smithi195 ceph-mon[33250]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' 2024-04-25T20:40:42.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:42 smithi112 ceph-mon[32322]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:40:42.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:42 smithi112 ceph-mon[32322]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T20:40:42.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:42.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:42 smithi112 ceph-mon[32322]: from='osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324]' entity='osd.0' 2024-04-25T20:40:42.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-04-25T20:40:43.127 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:40:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:40:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:40:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] boot 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi043 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:43.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] boot 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T20:40:44.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi043 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:44.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:40:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: osd.0 [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] boot 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi043 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 17093M 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:44.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:40:44.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 -- 172.21.15.112:0/3335703794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0103ca0 msgr2=0x7fabb0104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 --2- 172.21.15.112:0/3335703794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0103ca0 0x7fabb0104100 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faba00099c0 tx=0x7faba0009cd0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 -- 172.21.15.112:0/3335703794 shutdown_connections 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 --2- 172.21.15.112:0/3335703794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 0x7fabb010aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 --2- 172.21.15.112:0/3335703794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0102aa0 0x7fabb0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 --2- 172.21.15.112:0/3335703794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0103ca0 0x7fabb0104100 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 -- 172.21.15.112:0/3335703794 >> 172.21.15.112:0/3335703794 conn(0x7fabb00fe040 msgr2=0x7fabb0100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 -- 172.21.15.112:0/3335703794 shutdown_connections 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 -- 172.21.15.112:0/3335703794 wait complete. 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.667+0000 7fabb849f700 1 Processor -- start 2024-04-25T20:40:44.670 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 -- start start 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0103ca0 0x7fabb01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 0x7fabb01a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e6d0 con 0x7fabb0103ca0 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e550 con 0x7fabb0102aa0 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e850 con 0x7fabb0104640 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:33756/0 (socket says 172.21.15.112:33756) 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 -- 172.21.15.112:0/4273800529 learned_addr learned my addr 172.21.15.112:0/4273800529 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb6a3c700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 0x7fabb01a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb5a3a700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0103ca0 0x7fabb01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 -- 172.21.15.112:0/4273800529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 msgr2=0x7fabb01a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 0x7fabb01a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.671 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 -- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0103ca0 msgr2=0x7fabb01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0103ca0 0x7fabb01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 -- 172.21.15.112:0/4273800529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01a08c0 con 0x7fabb0102aa0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb623b700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c990 tx=0x7fabac00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac007940 con 0x7fabb0102aa0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01a0bb0 con 0x7fabb0102aa0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fabac00f450 con 0x7fabb0102aa0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.668+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac018660 con 0x7fabb0102aa0 2024-04-25T20:40:44.672 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.669+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01a1140 con 0x7fabb0102aa0 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.669+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb0069730 con 0x7fabb0102aa0 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.670+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fabac00f920 con 0x7fabb0102aa0 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.671+0000 7faba77fe700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 0x7fab9c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.671+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fabac0cea10 con 0x7fabb0102aa0 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.671+0000 7fabb5a3a700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 0x7fab9c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:40:44.673 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.672+0000 7fabb5a3a700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 0x7fab9c0a6070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faba0006010 tx=0x7faba0005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:40:44.676 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.675+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fabac014030 con 0x7fabb0102aa0 2024-04-25T20:40:44.883 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:40:44.882+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fabb0062e80 con 0x7fab9c0a3bb0 2024-04-25T20:40:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T20:40:46.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:46.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:46.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:46.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T20:40:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:45 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:40:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:40:46.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:45 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/4106493390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]': finished 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T20:40:47.918 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:40:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/4106493390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]': finished 2024-04-25T20:40:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T20:40:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:40:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:48.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/4106493390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:48.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]: dispatch 2024-04-25T20:40:48.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d509437-4cc7-4b3c-aedd-d207aac56272"}]': finished 2024-04-25T20:40:48.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T20:40:48.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:40:49.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:48 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/4097599173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:49.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:48 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/4097599173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:49.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:48 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/4097599173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:40:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:49 smithi043 ceph-mon[29167]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:49 smithi195 ceph-mon[33250]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:49 smithi112 ceph-mon[32322]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:51.777 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:51 smithi112 ceph-mon[32322]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:51 smithi043 ceph-mon[29167]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:51 smithi195 ceph-mon[33250]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:53.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:53 smithi112 ceph-mon[32322]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:53 smithi043 ceph-mon[29167]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:53 smithi195 ceph-mon[33250]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T20:40:54.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:54.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:54 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T20:40:54.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:54 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:54.946 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T20:40:54.946 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:40:55.633 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:55 smithi112 ceph-mon[32322]: Deploying daemon osd.1 on smithi112 2024-04-25T20:40:55.633 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:55 smithi112 ceph-mon[32322]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:55 smithi043 ceph-mon[29167]: Deploying daemon osd.1 on smithi112 2024-04-25T20:40:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:55 smithi043 ceph-mon[29167]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:55 smithi195 ceph-mon[33250]: Deploying daemon osd.1 on smithi112 2024-04-25T20:40:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:55 smithi195 ceph-mon[33250]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:57.816 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:57 smithi112 ceph-mon[32322]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:58.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:57 smithi043 ceph-mon[29167]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:57 smithi195 ceph-mon[33250]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:59.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:59 smithi112 ceph-mon[32322]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:40:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:40:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:40:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:59 smithi043 ceph-mon[29167]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:40:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:59 smithi195 ceph-mon[33250]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:40:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:01 smithi112 ceph-mon[32322]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:01 smithi043 ceph-mon[29167]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:01 smithi195 ceph-mon[33250]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:02.799 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.798+0000 7faba77fe700 1 -- 172.21.15.112:0/4273800529 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fabb0062e80 con 0x7fab9c0a3bb0 2024-04-25T20:41:02.799 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2024-04-25T20:41:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 msgr2=0x7fab9c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 0x7fab9c0a6070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faba0006010 tx=0x7faba0005c40 comp rx=0 tx=0).stop 2024-04-25T20:41:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 msgr2=0x7fabb0198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c990 tx=0x7fabac00cca0 comp rx=0 tx=0).stop 2024-04-25T20:41:02.801 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 shutdown_connections 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab9c0a3bb0 0x7fab9c0a6070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabb0104640 0x7fabb01a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fabb0102aa0 0x7fabb0198c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 --2- 172.21.15.112:0/4273800529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb0103ca0 0x7fabb01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 >> 172.21.15.112:0/4273800529 conn(0x7fabb00fe040 msgr2=0x7fabb0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 shutdown_connections 2024-04-25T20:41:02.802 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:02.800+0000 7fabb849f700 1 -- 172.21.15.112:0/4273800529 wait complete. 2024-04-25T20:41:03.398 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T20:41:03.400 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_4... 2024-04-25T20:41:03.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T20:41:03.648 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:41:03.699 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T20:41:03.451+0000 7f94a5b707c0 -1 osd.1 0 log_to_monitors true 2024-04-25T20:41:03.966 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:03.967 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:03 smithi112 ceph-mon[32322]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:04.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:03 smithi043 ceph-mon[29167]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:04.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:03 smithi195 ceph-mon[33250]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T20:41:04.937 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:04 smithi195 ceph-mon[33250]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T20:41:04.937 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:04 smithi195 ceph-mon[33250]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T20:41:04.938 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:04.938 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:04 smithi195 ceph-mon[33250]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:04.938 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:04 smithi195 ceph-mon[33250]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:05.294 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:04 smithi112 ceph-mon[32322]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T20:41:05.294 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:04 smithi112 ceph-mon[32322]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T20:41:05.294 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:05.294 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:04 smithi112 ceph-mon[32322]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:05.294 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:04 smithi112 ceph-mon[32322]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:05.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:04 smithi043 ceph-mon[29167]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T20:41:05.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:04 smithi043 ceph-mon[29167]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T20:41:05.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:05.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:04 smithi043 ceph-mon[29167]: from='osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:05.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:04 smithi043 ceph-mon[29167]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:41:05.537 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T20:41:05.537 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T20:41:05.537 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-25T20:41:05.537 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-25T20:41:05.537 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00839495 s, 1.2 GB/s 2024-04-25T20:41:05.538 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-25T20:41:05.592 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T20:41:05.292+0000 7f949b1d5700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T20:41:05.592 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T20:41:05.295+0000 7f9492fc0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.035 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:05 smithi112 ceph-mon[32322]: from='osd.1 ' entity='osd.1' 2024-04-25T20:41:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:41:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T20:41:06.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:05 smithi043 ceph-mon[29167]: from='osd.1 ' entity='osd.1' 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:06.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:05 smithi195 ceph-mon[33250]: from='osd.1 ' entity='osd.1' 2024-04-25T20:41:06.160 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-04-25T20:41:06.400 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:41:07.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:41:07.106 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] boot 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi112 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 17088M 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.107 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:07.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] boot 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi112 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 17088M 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: osd.1 [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] boot 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi112 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 17088M 2024-04-25T20:41:07.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:07.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:07.918 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- 172.21.15.195:0/746123410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c102aa0 msgr2=0x7fb53c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:07.918 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 --2- 172.21.15.195:0/746123410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c102aa0 0x7fb53c102ec0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009990 tx=0x7fb52c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- 172.21.15.195:0/746123410 shutdown_connections 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 --2- 172.21.15.195:0/746123410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c102aa0 0x7fb53c102ec0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 --2- 172.21.15.195:0/746123410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c104640 0x7fb53c10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 --2- 172.21.15.195:0/746123410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c103ca0 0x7fb53c104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- 172.21.15.195:0/746123410 >> 172.21.15.195:0/746123410 conn(0x7fb53c0fe040 msgr2=0x7fb53c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- 172.21.15.195:0/746123410 shutdown_connections 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- 172.21.15.195:0/746123410 wait complete. 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 Processor -- start 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.916+0000 7fb5412c7700 1 -- start start 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c102aa0 0x7fb53c076790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c103ca0 0x7fb53c074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c10e670 con 0x7fb53c102aa0 2024-04-25T20:41:07.919 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c10e4f0 con 0x7fb53c103ca0 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb5412c7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c10e7f0 con 0x7fb53c104640 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:51716/0 (socket says 172.21.15.195:51716) 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 -- 172.21.15.195:0/737641115 learned_addr learned my addr 172.21.15.195:0/737641115 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53affd700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c102aa0 0x7fb53c076790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53a7fc700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c103ca0 0x7fb53c074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 -- 172.21.15.195:0/737641115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c103ca0 msgr2=0x7fb53c074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c103ca0 0x7fb53c074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 -- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c102aa0 msgr2=0x7fb53c076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c102aa0 0x7fb53c076790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 -- 172.21.15.195:0/737641115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c075c40 con 0x7fb53c104640 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.917+0000 7fb53b7fe700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb53400ef30 tx=0x7fb53400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.918+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340092e0 con 0x7fb53c104640 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.918+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb534004bb0 con 0x7fb53c104640 2024-04-25T20:41:07.920 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.918+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534004280 con 0x7fb53c104640 2024-04-25T20:41:07.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.918+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53c1a2e20 con 0x7fb53c104640 2024-04-25T20:41:07.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.918+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53c1a31c0 con 0x7fb53c104640 2024-04-25T20:41:07.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.919+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53c069770 con 0x7fb53c104640 2024-04-25T20:41:07.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.920+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7fb53401b030 con 0x7fb53c104640 2024-04-25T20:41:07.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.920+0000 7fb523fff700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 0x7fb5240a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:07.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.921+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fb5340ce570 con 0x7fb53c104640 2024-04-25T20:41:07.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.921+0000 7fb53affd700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 0x7fb5240a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:07.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.921+0000 7fb53affd700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 0x7fb5240a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b7b0 tx=0x7fb52c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:07.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:07.925+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb534022020 con 0x7fb53c104640 2024-04-25T20:41:08.131 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:08.131+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb53c062e80 con 0x7fb5240a3c30 2024-04-25T20:41:08.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:08 smithi195 ceph-mon[33250]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:08 smithi195 ceph-mon[33250]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:08 smithi112 ceph-mon[32322]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:08 smithi112 ceph-mon[32322]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:08.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:08.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:08 smithi043 ceph-mon[29167]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-25T20:41:08.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:08 smithi043 ceph-mon[29167]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T20:41:08.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:08.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:08.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:09.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:09 smithi195 ceph-mon[33250]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:09.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:09 smithi112 ceph-mon[32322]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:09.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:09 smithi043 ceph-mon[29167]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:10 smithi195 ceph-mon[33250]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:10.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:10 smithi112 ceph-mon[32322]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:10.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:10 smithi043 ceph-mon[29167]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:11 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/2052312802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:11 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:11 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]': finished 2024-04-25T20:41:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:11 smithi195 ceph-mon[33250]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T20:41:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:11 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/2052312802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:11 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:11 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]': finished 2024-04-25T20:41:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:11 smithi112 ceph-mon[32322]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T20:41:11.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:11.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:11 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/2052312802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:11 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]: dispatch 2024-04-25T20:41:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:11 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a14b64b6-b983-417a-b55b-9c2c73ad97a8"}]': finished 2024-04-25T20:41:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:11 smithi043 ceph-mon[29167]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T20:41:11.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:12.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:12 smithi195 ceph-mon[33250]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:12.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:12 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/3311279093' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:12.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:12 smithi112 ceph-mon[32322]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:12.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:12 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/3311279093' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:12.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:12 smithi043 ceph-mon[29167]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:12.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:12 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/3311279093' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:14.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:14 smithi195 ceph-mon[33250]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:14.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:14 smithi112 ceph-mon[32322]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:14.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:14 smithi043 ceph-mon[29167]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:16 smithi195 ceph-mon[33250]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:16.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:16 smithi112 ceph-mon[32322]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:16.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:16 smithi043 ceph-mon[29167]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:18.590 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:18 smithi195 ceph-mon[33250]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:18.590 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T20:41:18.590 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:18.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:18 smithi112 ceph-mon[32322]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:18.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T20:41:18.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:18.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:18 smithi043 ceph-mon[29167]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:18.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T20:41:18.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:19.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:19 smithi195 ceph-mon[33250]: Deploying daemon osd.2 on smithi195 2024-04-25T20:41:19.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:19 smithi112 ceph-mon[32322]: Deploying daemon osd.2 on smithi195 2024-04-25T20:41:19.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:19 smithi043 ceph-mon[29167]: Deploying daemon osd.2 on smithi195 2024-04-25T20:41:20.499 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:20 smithi195 ceph-mon[33250]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:20.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:20 smithi112 ceph-mon[32322]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:20 smithi043 ceph-mon[29167]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:22.582 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:22 smithi195 ceph-mon[33250]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:22.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:22 smithi112 ceph-mon[32322]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:22.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:22 smithi043 ceph-mon[29167]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:24.375 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:24 smithi195 ceph-mon[33250]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:24.375 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:24 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.375 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:24 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.375 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:24 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:24.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:24 smithi043 ceph-mon[29167]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:24.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:24 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:24 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:24 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:24.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:24 smithi112 ceph-mon[32322]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:24.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:24 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:24 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:24.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:24 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:26.335 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.398 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.396+0000 7fb523fff700 1 -- 172.21.15.195:0/737641115 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb53c062e80 con 0x7fb5240a3c30 2024-04-25T20:41:26.398 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 msgr2=0x7fb5240a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 0x7fb5240a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b7b0 tx=0x7fb52c005fd0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 msgr2=0x7fb53c075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb53400ef30 tx=0x7fb53400c3a0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 shutdown_connections 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5240a3c30 0x7fb5240a60f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb53c104640 0x7fb53c075370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb53c102aa0 0x7fb53c076790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 --2- 172.21.15.195:0/737641115 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb53c103ca0 0x7fb53c074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 >> 172.21.15.195:0/737641115 conn(0x7fb53c0fe040 msgr2=0x7fb53c107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 shutdown_connections 2024-04-25T20:41:26.401 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:41:26.399+0000 7fb5412c7700 1 -- 172.21.15.195:0/737641115 wait complete. 2024-04-25T20:41:26.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:26.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:26.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:26.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:26.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:26.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.008 DEBUG:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T20:41:27.010 INFO:tasks.cephadm:Deploying osd.3 on smithi043 with /dev/vg_nvme/lv_3... 2024-04-25T20:41:27.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T20:41:27.266 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:41:27.295 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T20:41:27.049+0000 7f57c680e7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T20:41:27.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:27.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-mon[33250]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:27.558 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:27 smithi195 ceph-mon[33250]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:27.650 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:27 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:27 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:27 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:27 smithi112 ceph-mon[32322]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:27 smithi112 ceph-mon[32322]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:27.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:27 smithi043 ceph-mon[29167]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:27.652 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:27 smithi043 ceph-mon[29167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T20:41:28.549 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T20:41:28.385+0000 7f57bbe73700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T20:41:28.549 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T20:41:28.390+0000 7f57b7c66700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:28.549 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:28 smithi195 ceph-mon[33250]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:28.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:28.710 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T20:41:28.711 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T20:41:28.711 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:28.711 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:28.711 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:28 smithi043 ceph-mon[29167]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: from='osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:28 smithi112 ceph-mon[32322]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:41:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T20:41:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T20:41:29.417 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T20:41:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T20:41:29.418 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.008973 s, 1.2 GB/s 2024-04-25T20:41:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T20:41:29.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:29 smithi195 ceph-mon[33250]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:41:29.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:29 smithi195 ceph-mon[33250]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T20:41:29.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:29 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:29.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:29 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:29.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:29 smithi043 ceph-mon[29167]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:41:29.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:29 smithi043 ceph-mon[29167]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T20:41:29.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:29 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:29.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:29 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:29.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:29 smithi112 ceph-mon[32322]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:41:29.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:29 smithi112 ceph-mon[32322]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T20:41:29.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:29 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:29.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:29 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:30.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_3 2024-04-25T20:41:30.474 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:41:30.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] boot 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:30.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:30 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] boot 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:30 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: osd.2 [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] boot 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:41:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:30.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:30 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:31.749 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:31 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi195 2024-04-25T20:41:31.750 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:31 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 17088M 2024-04-25T20:41:31.750 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:31 smithi043 ceph-mon[29167]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T20:41:31.750 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:31.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:31 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi195 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:31 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 17088M 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:31 smithi195 ceph-mon[33250]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:31 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi195 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:31 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 17088M 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:31 smithi112 ceph-mon[32322]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T20:41:31.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 -- 172.21.15.43:0/703443702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d48102ba0 msgr2=0x7f1d48103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 --2- 172.21.15.43:0/703443702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d48102ba0 0x7f1d48103000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0099c0 tx=0x7f1d3c009cd0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 -- 172.21.15.43:0/703443702 shutdown_connections 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 --2- 172.21.15.43:0/703443702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d481019a0 0x7f1d48101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 --2- 172.21.15.43:0/703443702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48103540 0x7f1d48109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 --2- 172.21.15.43:0/703443702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d48102ba0 0x7f1d48103000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 -- 172.21.15.43:0/703443702 >> 172.21.15.43:0/703443702 conn(0x7f1d480fcf60 msgr2=0x7f1d480ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 -- 172.21.15.43:0/703443702 shutdown_connections 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.237+0000 7f1d4e712700 1 -- 172.21.15.43:0/703443702 wait complete. 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 Processor -- start 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 -- start start 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48102ba0 0x7f1d48103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 0x7f1d481044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4810d550 con 0x7f1d481019a0 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4810d3d0 con 0x7f1d48102ba0 2024-04-25T20:41:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4e712700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4810d6d0 con 0x7f1d48103540 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54042/0 (socket says 172.21.15.43:54042) 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d47fff700 1 -- 172.21.15.43:0/1618911192 learned_addr learned my addr 172.21.15.43:0/1618911192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d4ccaf700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 0x7f1d481044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.238+0000 7f1d477fe700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48102ba0 0x7f1d48103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 -- 172.21.15.43:0/1618911192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 msgr2=0x7f1d481044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 0x7f1d481044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 -- 172.21.15.43:0/1618911192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48102ba0 msgr2=0x7f1d48103f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48102ba0 0x7f1d48103f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 -- 172.21.15.43:0/1618911192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d48104d70 con 0x7f1d481019a0 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d4ccaf700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 0x7f1d481044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:41:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d47fff700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800c970 tx=0x7f1d3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004220 con 0x7f1d481019a0 2024-04-25T20:41:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d481a2e10 con 0x7f1d481019a0 2024-04-25T20:41:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d38007d70 con 0x7f1d481019a0 2024-04-25T20:41:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38003da0 con 0x7f1d481019a0 2024-04-25T20:41:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.239+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d481a3210 con 0x7f1d481019a0 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.240+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d481a34f0 con 0x7f1d481019a0 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.241+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f1d380078a0 con 0x7f1d481019a0 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.242+0000 7f1d457fa700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 0x7f1d300a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.242+0000 7f1d477fe700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 0x7f1d300a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.242+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3226+0+0 (secure 0 0 0) 0x7f1d380cee90 con 0x7f1d481019a0 2024-04-25T20:41:32.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.243+0000 7f1d477fe700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 0x7f1d300a6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009990 tx=0x7f1d3c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:32.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.246+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1d38014030 con 0x7f1d481019a0 2024-04-25T20:41:32.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:32.485+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1d480ff110 con 0x7f1d300a3bb0 2024-04-25T20:41:32.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42063]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:32.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42063]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:32.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42063]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:32.662 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42063]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:32.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 ceph-mon[33250]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:32.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:32.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 ceph-mon[33250]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T20:41:32.662 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:32.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 ceph-mon[29167]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:32.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:32.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 ceph-mon[29167]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T20:41:32.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48796]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48796]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48796]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48796]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48831]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48831]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48831]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:32.708 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48831]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:32.782 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 ceph-mon[32322]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:32.782 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:32.783 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 ceph-mon[32322]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T20:41:32.783 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40961]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40961]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40964]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40964]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40964]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:32.783 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40964]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48852]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:33.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48852]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48852]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48852]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48855]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48855]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48855]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:32 smithi043 sudo[48855]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.091 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:33.091 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.091 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42066]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.092 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42066]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42069]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42069]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42072]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:32 smithi195 sudo[42072]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40967]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40967]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40967]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40967]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40970]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40970]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40970]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T20:41:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:32 smithi112 sudo[40970]: pam_unix(sudo:session): session closed for user root 2024-04-25T20:41:33.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:33.582+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1d38098c00 con 0x7f1d481019a0 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:33 smithi043 ceph-mon[29167]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:33 smithi195 ceph-mon[33250]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:41:33.845 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:33 smithi112 ceph-mon[32322]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T20:41:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:34 smithi043 ceph-mon[29167]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:34 smithi043 ceph-mon[29167]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:34 smithi043 ceph-mon[29167]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T20:41:34.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:34 smithi043 ceph-mon[29167]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T20:41:34.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:34 smithi195 ceph-mon[33250]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:34 smithi195 ceph-mon[33250]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:34 smithi195 ceph-mon[33250]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:34 smithi195 ceph-mon[33250]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:34 smithi112 ceph-mon[32322]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:34 smithi112 ceph-mon[32322]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:34 smithi112 ceph-mon[32322]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T20:41:34.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:34 smithi112 ceph-mon[32322]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-25T20:41:35.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]: dispatch 2024-04-25T20:41:35.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]': finished 2024-04-25T20:41:35.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:35 smithi043 ceph-mon[29167]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T20:41:35.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:35.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]: dispatch 2024-04-25T20:41:35.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]': finished 2024-04-25T20:41:35.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:35 smithi195 ceph-mon[33250]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T20:41:35.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:35.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]: dispatch 2024-04-25T20:41:35.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2486039858' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20ea1a7-c87a-42fc-a98f-e7874e1560db"}]': finished 2024-04-25T20:41:35.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:35 smithi112 ceph-mon[32322]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T20:41:35.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:36.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:36 smithi043 ceph-mon[29167]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:36.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:36 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3382358529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:36.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:36 smithi195 ceph-mon[33250]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:36.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:36 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3382358529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:36.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:36 smithi112 ceph-mon[32322]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:36.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:36 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3382358529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:41:38.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:38 smithi043 ceph-mon[29167]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:38.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:38 smithi195 ceph-mon[33250]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:38.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:38 smithi112 ceph-mon[32322]: pgmap v89: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:40.534 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:40 smithi043 ceph-mon[29167]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:40.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:40 smithi195 ceph-mon[33250]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:40 smithi112 ceph-mon[32322]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:42.600 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:42 smithi043 ceph-mon[29167]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:42.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:42 smithi195 ceph-mon[33250]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:42.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:42 smithi112 ceph-mon[32322]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:43.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T20:41:43.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:43.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T20:41:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:43.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T20:41:43.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:44.652 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:44 smithi043 ceph-mon[29167]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:44.652 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:44 smithi043 ceph-mon[29167]: Deploying daemon osd.3 on smithi043 2024-04-25T20:41:44.743 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:44 smithi195 ceph-mon[33250]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:44.743 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:44 smithi195 ceph-mon[33250]: Deploying daemon osd.3 on smithi043 2024-04-25T20:41:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:44 smithi112 ceph-mon[32322]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:44.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:44 smithi112 ceph-mon[32322]: Deploying daemon osd.3 on smithi043 2024-04-25T20:41:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:46 smithi043 ceph-mon[29167]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:46 smithi195 ceph-mon[33250]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:46.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:46 smithi112 ceph-mon[32322]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:48.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:48 smithi043 ceph-mon[29167]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:48.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:48 smithi195 ceph-mon[33250]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:48.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:48 smithi112 ceph-mon[32322]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:49.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:49.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:50.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:50 smithi043 ceph-mon[29167]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:50.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:50 smithi195 ceph-mon[33250]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:50.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:50 smithi112 ceph-mon[32322]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:52.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.274+0000 7f1d457fa700 1 -- 172.21.15.43:0/1618911192 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d480ff110 con 0x7f1d300a3bb0 2024-04-25T20:41:52.276 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 3 on host 'smithi043' 2024-04-25T20:41:52.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 msgr2=0x7f1d300a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:52.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 0x7f1d300a6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009990 tx=0x7f1d3c009f10 comp rx=0 tx=0).stop 2024-04-25T20:41:52.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 msgr2=0x7f1d48105930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:52.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800c970 tx=0x7f1d3800cc80 comp rx=0 tx=0).stop 2024-04-25T20:41:52.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 shutdown_connections 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1d300a3bb0 0x7f1d300a6070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d48103540 0x7f1d481044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1d481019a0 0x7f1d48105930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 --2- 172.21.15.43:0/1618911192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1d48102ba0 0x7f1d48103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 >> 172.21.15.43:0/1618911192 conn(0x7f1d480fcf60 msgr2=0x7f1d480fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 shutdown_connections 2024-04-25T20:41:52.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:41:52.277+0000 7f1d4e712700 1 -- 172.21.15.43:0/1618911192 wait complete. 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:52.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:41:52.909 DEBUG:teuthology.orchestra.run.smithi043:osd.3> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T20:41:52.911 INFO:tasks.cephadm:Deploying osd.4 on smithi112 with /dev/vg_nvme/lv_3... 2024-04-25T20:41:52.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T20:41:53.153 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:41:53.477 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:53 smithi043 ceph-mon[29167]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T20:41:53.578 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:53 smithi112 ceph-mon[32322]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T20:41:53.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:53 smithi195 ceph-mon[33250]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T20:41:54.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-mon[29167]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:54.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-mon[29167]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T20:41:54.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-mon[29167]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T20:41:54.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-mon[29167]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:41:54.391 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:54.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:54 smithi112 ceph-mon[32322]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:54.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:54 smithi112 ceph-mon[32322]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T20:41:54.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:54 smithi112 ceph-mon[32322]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T20:41:54.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:54 smithi112 ceph-mon[32322]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:41:54.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:54 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:54.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:54 smithi195 ceph-mon[33250]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:54.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:54 smithi195 ceph-mon[33250]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T20:41:54.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:54 smithi195 ceph-mon[33250]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T20:41:54.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:54 smithi195 ceph-mon[33250]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:41:54.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.045 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T20:41:54.811+0000 7f0bf8786700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T20:41:55.045 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 20:41:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T20:41:54.817+0000 7f0bf0571700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:41:55.050 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T20:41:55.050 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T20:41:55.051 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T20:41:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T20:41:55.051 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011359 s, 923 MB/s 2024-04-25T20:41:55.051 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:55 smithi195 ceph-mon[33250]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:55 smithi195 ceph-mon[33250]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:55 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:55 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:55 smithi195 ceph-mon[33250]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:55 smithi112 ceph-mon[32322]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:41:55.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:55 smithi112 ceph-mon[32322]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T20:41:55.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:55 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:55 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:55 smithi112 ceph-mon[32322]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' 2024-04-25T20:41:55.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-04-25T20:41:55.708 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:55 smithi043 ceph-mon[29167]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:41:55.708 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:55 smithi043 ceph-mon[29167]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T20:41:55.708 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:55 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.708 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:55 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:55.708 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:55 smithi043 ceph-mon[29167]: from='osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045]' entity='osd.3' 2024-04-25T20:41:55.894 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:41:56.377 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:41:56.377 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:41:56.378 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:56.378 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:56.378 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] boot 2024-04-25T20:41:56.378 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T20:41:56.378 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:56.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:41:56.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:41:56.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] boot 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: osd.3 [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] boot 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T20:41:56.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.483+0000 7f822876a700 1 -- 172.21.15.112:0/3861172500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 msgr2=0x7f8220102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.483+0000 7f822876a700 1 --2- 172.21.15.112:0/3861172500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220102ec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099c0 tx=0x7f821c009cd0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 -- 172.21.15.112:0/3861172500 shutdown_connections 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 --2- 172.21.15.112:0/3861172500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 0x7f822010aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 --2- 172.21.15.112:0/3861172500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220102ec0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 --2- 172.21.15.112:0/3861172500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 -- 172.21.15.112:0/3861172500 >> 172.21.15.112:0/3861172500 conn(0x7f82200fe040 msgr2=0x7f8220100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:41:57.487 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 -- 172.21.15.112:0/3861172500 shutdown_connections 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 -- 172.21.15.112:0/3861172500 wait complete. 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 Processor -- start 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.484+0000 7f822876a700 1 -- start start 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 0x7f82201a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f822010e650 con 0x7f8220104640 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f822010e4d0 con 0x7f8220102aa0 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f822010e7d0 con 0x7f8220103ca0 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:46302/0 (socket says 172.21.15.112:46302) 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 -- 172.21.15.112:0/1768274075 learned_addr learned my addr 172.21.15.112:0/1768274075 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T20:41:57.488 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226d07700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 0x7f82201a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8225d05700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 -- 172.21.15.112:0/1768274075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 msgr2=0x7f8220199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 -- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 msgr2=0x7f82201a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 0x7f82201a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 -- 172.21.15.112:0/1768274075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82201a0930 con 0x7f8220102aa0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8225d05700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f8226506700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f821c006010 tx=0x7f821c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c027070 con 0x7f8220102aa0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f821c004090 con 0x7f8220102aa0 2024-04-25T20:41:57.489 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82201a0bc0 con 0x7f8220102aa0 2024-04-25T20:41:57.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.485+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00f460 con 0x7f8220102aa0 2024-04-25T20:41:57.490 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.486+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82201a1010 con 0x7f8220102aa0 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.486+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8220069730 con 0x7f8220102aa0 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.487+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f821c02a070 con 0x7f8220102aa0 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.488+0000 7f82177fe700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 0x7f820c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.488+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f821c0d0120 con 0x7f8220102aa0 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.488+0000 7f8225d05700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 0x7f820c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:41:57.491 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.489+0000 7f8225d05700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 0x7f820c0a6100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f8210005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:41:57.491 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T20:41:57.491 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi043 2024-04-25T20:41:57.491 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.491 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:57.492 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.493 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.493+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f821c05eff0 con 0x7f8220102aa0 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi043 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:57.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.699 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:41:57.698+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8220062e80 con 0x7f820c0a3c40 2024-04-25T20:41:57.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi043 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:41:57.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:58 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:58.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:58.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:58 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:58.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 8546M 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:41:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:58 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:41:59.554 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:59 smithi112 ceph-mon[32322]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:59.554 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:41:59 smithi112 ceph-mon[32322]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T20:41:59.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:59 smithi043 ceph-mon[29167]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:59.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:41:59 smithi043 ceph-mon[29167]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T20:41:59.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:59 smithi195 ceph-mon[33250]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:41:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:41:59 smithi195 ceph-mon[33250]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T20:42:00.726 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:00.726 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/803268528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.727 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.727 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]': finished 2024-04-25T20:42:00.727 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T20:42:00.727 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:00 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/803268528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]': finished 2024-04-25T20:42:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T20:42:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:00 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:00.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/803268528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]: dispatch 2024-04-25T20:42:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063"}]': finished 2024-04-25T20:42:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T20:42:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:00 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:01.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/2866934450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:01.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/2866934450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:01.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/2866934450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:02 smithi043 ceph-mon[29167]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:02 smithi195 ceph-mon[33250]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:02.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:02 smithi112 ceph-mon[32322]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:04.697 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:04 smithi112 ceph-mon[32322]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-25T20:42:04.721 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:04 smithi195 ceph-mon[33250]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-25T20:42:04.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:04 smithi043 ceph-mon[29167]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-04-25T20:42:06.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:06 smithi043 ceph-mon[29167]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:06.563 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:06 smithi112 ceph-mon[32322]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:06 smithi195 ceph-mon[33250]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:08.556 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:08 smithi112 ceph-mon[32322]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:08.556 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T20:42:08.556 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:08 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:08.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:08 smithi043 ceph-mon[29167]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:08.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T20:42:08.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:08 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:08.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:08 smithi195 ceph-mon[33250]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:08.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T20:42:08.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:08 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:09.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:09 smithi112 ceph-mon[32322]: Deploying daemon osd.4 on smithi112 2024-04-25T20:42:09.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:09 smithi043 ceph-mon[29167]: Deploying daemon osd.4 on smithi112 2024-04-25T20:42:09.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:09 smithi195 ceph-mon[33250]: Deploying daemon osd.4 on smithi112 2024-04-25T20:42:10.696 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:10 smithi112 ceph-mon[32322]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:42:10.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:10 smithi043 ceph-mon[29167]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:42:10.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:10 smithi195 ceph-mon[33250]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:42:12.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:12 smithi112 ceph-mon[32322]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T20:42:12.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:12 smithi043 ceph-mon[29167]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T20:42:12.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:12 smithi195 ceph-mon[33250]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-25T20:42:14.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:14 smithi043 ceph-mon[29167]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T20:42:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:14.558 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:14 smithi112 ceph-mon[32322]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T20:42:14.558 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.558 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.558 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:14.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:14 smithi195 ceph-mon[33250]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T20:42:14.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:14.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:16.515 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:16 smithi112 ceph-mon[32322]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:16.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:16 smithi043 ceph-mon[29167]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:16 smithi195 ceph-mon[33250]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:17.070 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 4 on host 'smithi112' 2024-04-25T20:42:17.070 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.068+0000 7f82177fe700 1 -- 172.21.15.112:0/1768274075 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8220062e80 con 0x7f820c0a3c40 2024-04-25T20:42:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 msgr2=0x7f820c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 0x7f820c0a6100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8210005950 tx=0x7f8210005f50 comp rx=0 tx=0).stop 2024-04-25T20:42:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 msgr2=0x7f8220198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f821c006010 tx=0x7f821c0047b0 comp rx=0 tx=0).stop 2024-04-25T20:42:17.072 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 shutdown_connections 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f820c0a3c40 0x7f820c0a6100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8220104640 0x7f82201a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8220102aa0 0x7f8220198ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 --2- 172.21.15.112:0/1768274075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8220103ca0 0x7f8220199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 >> 172.21.15.112:0/1768274075 conn(0x7f82200fe040 msgr2=0x7f8220107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 shutdown_connections 2024-04-25T20:42:17.073 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:42:17.071+0000 7f822876a700 1 -- 172.21.15.112:0/1768274075 wait complete. 2024-04-25T20:42:17.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:17 smithi112 ceph-mon[32322]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:17 smithi043 ceph-mon[29167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:17 smithi195 ceph-mon[33250]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T20:42:17.724 DEBUG:teuthology.orchestra.run.smithi112:osd.4> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T20:42:17.727 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2024-04-25T20:42:17.727 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T20:42:17.970 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:42:18.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:18.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T20:42:18.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:18.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T20:42:18.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:18.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:18 smithi195 ceph-mon[33250]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:18.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:18.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T20:42:18.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:18.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T20:42:18.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:18.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:18 smithi043 ceph-mon[29167]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:18.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:18.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T20:42:18.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: from='osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:18.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T20:42:18.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:18.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:18 smithi112 ceph-mon[32322]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:42:19.170 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 20:42:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T20:42:19.031+0000 7f1d618ca700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T20:42:19.171 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 20:42:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T20:42:19.037+0000 7f1d5d6bd700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:42:19.910 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T20:42:19.911 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T20:42:19.911 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-25T20:42:19.911 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-25T20:42:19.911 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00834939 s, 1.3 GB/s 2024-04-25T20:42:19.911 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-25T20:42:20.229 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:20 smithi195 ceph-mon[33250]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:20.229 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:20 smithi195 ceph-mon[33250]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:42:20.229 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:20 smithi195 ceph-mon[33250]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T20:42:20.229 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.229 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.281 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:20 smithi112 ceph-mon[32322]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:20.281 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:20 smithi112 ceph-mon[32322]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:42:20.281 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:20 smithi112 ceph-mon[32322]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T20:42:20.281 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.281 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:20 smithi043 ceph-mon[29167]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-04-25T20:42:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:20 smithi043 ceph-mon[29167]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:42:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:20 smithi043 ceph-mon[29167]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T20:42:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:20.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-04-25T20:42:20.801 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] boot 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:21.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:21.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] boot 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:21.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:42:21.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: osd.4 [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] boot 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:21.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:22.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:22 smithi195 ceph-mon[33250]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:22.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:22 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi112 2024-04-25T20:42:22.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:22 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 8544M 2024-04-25T20:42:22.140 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:22 smithi195 ceph-mon[33250]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T20:42:22.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:22 smithi043 ceph-mon[29167]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:22.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:22 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi112 2024-04-25T20:42:22.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:22 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 8544M 2024-04-25T20:42:22.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:22 smithi043 ceph-mon[29167]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T20:42:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:22 smithi112 ceph-mon[32322]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:22 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi112 2024-04-25T20:42:22.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:22 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 8544M 2024-04-25T20:42:22.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:22 smithi112 ceph-mon[32322]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T20:42:22.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 -- 172.21.15.195:0/651008587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 msgr2=0x7f9048104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:22.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 --2- 172.21.15.195:0/651008587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048104100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f903c009990 tx=0x7f903c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 -- 172.21.15.195:0/651008587 shutdown_connections 2024-04-25T20:42:22.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 --2- 172.21.15.195:0/651008587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f904810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 --2- 172.21.15.195:0/651008587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 0x7f9048102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 --2- 172.21.15.195:0/651008587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048104100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 -- 172.21.15.195:0/651008587 >> 172.21.15.195:0/651008587 conn(0x7f90480fe040 msgr2=0x7f9048100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 -- 172.21.15.195:0/651008587 shutdown_connections 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 -- 172.21.15.195:0/651008587 wait complete. 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.366+0000 7f904dc3b700 1 Processor -- start 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 -- start start 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 0x7f9048198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:22.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f90481a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f904810e670 con 0x7f9048104640 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f904810e4f0 con 0x7f9048102aa0 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f904dc3b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f904810e7f0 con 0x7f9048103ca0 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34514/0 (socket says 172.21.15.195:34514) 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 -- 172.21.15.195:0/3384037156 learned_addr learned my addr 172.21.15.195:0/3384037156 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f90477fe700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 0x7f9048198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9047fff700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f90481a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 -- 172.21.15.195:0/3384037156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 msgr2=0x7f9048198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 0x7f9048198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 -- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 msgr2=0x7f90481a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:22.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f90481a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 -- 172.21.15.195:0/3384037156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90481a0950 con 0x7f9048103ca0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9047fff700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f90481a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9046ffd700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f903c005910 tx=0x7f903c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.367+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c027070 con 0x7f9048103ca0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.368+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f903c004120 con 0x7f9048103ca0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.368+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90481a0be0 con 0x7f9048103ca0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.368+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c00f460 con 0x7f9048103ca0 2024-04-25T20:42:22.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.368+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90481a1030 con 0x7f9048103ca0 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.369+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9048069730 con 0x7f9048103ca0 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.370+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f903c02a070 con 0x7f9048103ca0 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.370+0000 7f9044ff9700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 0x7f90300a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.371+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f903c0d0380 con 0x7f9048103ca0 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.371+0000 7f90477fe700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 0x7f90300a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:22.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.371+0000 7f90477fe700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 0x7f90300a6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f904819a1e0 tx=0x7f903800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:42:22.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.375+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f903c05eff0 con 0x7f9048103ca0 2024-04-25T20:42:22.582 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:22.580+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9048062e80 con 0x7f90300a3c40 2024-04-25T20:42:23.305 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:23.305 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:23.305 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:23.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:23.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:23.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:24.311 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:24 smithi195 ceph-mon[33250]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:24.311 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:24 smithi195 ceph-mon[33250]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:24 smithi112 ceph-mon[32322]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:24.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:24 smithi112 ceph-mon[32322]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:24 smithi043 ceph-mon[29167]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:24.445 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:24 smithi043 ceph-mon[29167]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/2581655627' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]': finished 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:26 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/1906165561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/2581655627' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]': finished 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:26.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:26 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/1906165561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:26.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/2581655627' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]: dispatch 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "655a8020-e914-4eb9-8eb6-b00c7f1a68e3"}]': finished 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:26.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:26 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/1906165561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:28 smithi195 ceph-mon[33250]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:28 smithi112 ceph-mon[32322]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:28.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:28 smithi043 ceph-mon[29167]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:30 smithi195 ceph-mon[33250]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:30 smithi112 ceph-mon[32322]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:30.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:30 smithi043 ceph-mon[29167]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:32.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:32 smithi195 ceph-mon[33250]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:32 smithi112 ceph-mon[32322]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:32.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:32 smithi043 ceph-mon[29167]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:33.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T20:42:33.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:33.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T20:42:33.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:33.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T20:42:33.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:34 smithi195 ceph-mon[33250]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:34 smithi195 ceph-mon[33250]: Deploying daemon osd.5 on smithi195 2024-04-25T20:42:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:34 smithi112 ceph-mon[32322]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:34 smithi112 ceph-mon[32322]: Deploying daemon osd.5 on smithi195 2024-04-25T20:42:34.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:34 smithi043 ceph-mon[29167]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:34.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:34 smithi043 ceph-mon[29167]: Deploying daemon osd.5 on smithi195 2024-04-25T20:42:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:36 smithi195 ceph-mon[33250]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:36 smithi112 ceph-mon[32322]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:36.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:36 smithi043 ceph-mon[29167]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:38.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:38 smithi195 ceph-mon[33250]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:38 smithi112 ceph-mon[32322]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:38.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:38 smithi043 ceph-mon[29167]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:39.314 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:39.314 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:39.314 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:39.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:39.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:39.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:39.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:40.706 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:40 smithi195 ceph-mon[33250]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:40.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:40 smithi043 ceph-mon[29167]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:40 smithi112 ceph-mon[32322]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:42.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:42.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.138 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:42.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:42.139 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:42 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.206 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.204+0000 7f9044ff9700 1 -- 172.21.15.195:0/3384037156 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9048062e80 con 0x7f90300a3c40 2024-04-25T20:42:42.206 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 msgr2=0x7f90300a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 0x7f90300a6100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f904819a1e0 tx=0x7f903800b410 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 msgr2=0x7f9048199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f903c005910 tx=0x7f903c009580 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 shutdown_connections 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f90300a3c40 0x7f90300a6100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9048104640 0x7f90481a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9048102aa0 0x7f9048198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 --2- 172.21.15.195:0/3384037156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9048103ca0 0x7f9048199240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 >> 172.21.15.195:0/3384037156 conn(0x7f90480fe040 msgr2=0x7f9048107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 shutdown_connections 2024-04-25T20:42:42.208 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:42:42.207+0000 7f904dc3b700 1 -- 172.21.15.195:0/3384037156 wait complete. 2024-04-25T20:42:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:42.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:42.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:42 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:42.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:42.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:42.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:42 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:42.952 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T20:42:42.954 INFO:tasks.cephadm:Deploying osd.6 on smithi043 with /dev/vg_nvme/lv_2... 2024-04-25T20:42:42.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T20:42:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:42:43.276 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.276 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.276 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:43.277 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:43 smithi195 ceph-mon[33250]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:43.277 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:43 smithi195 ceph-mon[33250]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:43.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:43.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:43 smithi043 ceph-mon[29167]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:43.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:43 smithi043 ceph-mon[29167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:43.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:43.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:42:43.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:43 smithi112 ceph-mon[32322]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:43.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:43 smithi112 ceph-mon[32322]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T20:42:44.442 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:44.443 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T20:42:44.443 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T20:42:44.443 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.443 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:44.443 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-mon[33250]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:44 smithi043 ceph-mon[29167]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:44.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T20:42:44.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T20:42:44.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: from='osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:44.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:44 smithi112 ceph-mon[32322]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:42:44.779 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T20:42:44.623+0000 7fcd3077a700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T20:42:44.779 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 20:42:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T20:42:44.630+0000 7fcd27d64700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:42:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T20:42:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T20:42:45.480 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T20:42:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T20:42:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00841881 s, 1.2 GB/s 2024-04-25T20:42:45.480 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 2024-04-25T20:42:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T20:42:45.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:45 smithi043 ceph-mon[29167]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:42:45.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:45 smithi043 ceph-mon[29167]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T20:42:45.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:45 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.480 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:45 smithi043 ceph-mon[29167]: from='osd.5 ' entity='osd.5' 2024-04-25T20:42:45.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:45 smithi195 ceph-mon[33250]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:42:45.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:45 smithi195 ceph-mon[33250]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T20:42:45.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:45 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:45 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:45 smithi195 ceph-mon[33250]: from='osd.5 ' entity='osd.5' 2024-04-25T20:42:45.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:45 smithi112 ceph-mon[32322]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:42:45.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:45 smithi112 ceph-mon[32322]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T20:42:45.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:45 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:45 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:45.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:45 smithi112 ceph-mon[32322]: from='osd.5 ' entity='osd.5' 2024-04-25T20:42:46.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_2 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] boot 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:46.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:46.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:46 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.430 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] boot 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:46.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:46.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:46 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: osd.5 [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] boot 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:42:46.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:46 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:42:47.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:47 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi195 2024-04-25T20:42:47.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:47 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 8544M 2024-04-25T20:42:47.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:47 smithi043 ceph-mon[29167]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T20:42:47.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:47 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi195 2024-04-25T20:42:47.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:47 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 8544M 2024-04-25T20:42:47.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:47 smithi195 ceph-mon[33250]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T20:42:47.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:47 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi195 2024-04-25T20:42:47.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:47 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 8544M 2024-04-25T20:42:47.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:47 smithi112 ceph-mon[32322]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T20:42:48.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 -- 172.21.15.43:0/2937427737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c1019a0 msgr2=0x7f3b6c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 --2- 172.21.15.43:0/2937427737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c101dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b0d0 tx=0x7f3b5c00b3e0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 -- 172.21.15.43:0/2937427737 shutdown_connections 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 --2- 172.21.15.43:0/2937427737 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c103540 0x7f3b6c109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 --2- 172.21.15.43:0/2937427737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c101dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 --2- 172.21.15.43:0/2937427737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 0x7f3b6c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 -- 172.21.15.43:0/2937427737 >> 172.21.15.43:0/2937427737 conn(0x7f3b6c0fcf40 msgr2=0x7f3b6c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 -- 172.21.15.43:0/2937427737 shutdown_connections 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.177+0000 7f3b72163700 1 -- 172.21.15.43:0/2937427737 wait complete. 2024-04-25T20:42:48.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.178+0000 7f3b72163700 1 Processor -- start 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.178+0000 7f3b72163700 1 -- start start 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 0x7f3b6c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c10d570 con 0x7f3b6c103540 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c10d3f0 con 0x7f3b6c1019a0 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b72163700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c10d6f0 con 0x7f3b6c102ba0 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52530/0 (socket says 172.21.15.43:52530) 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 -- 172.21.15.43:0/564109157 learned_addr learned my addr 172.21.15.43:0/564109157 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:42:48.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6affd700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 0x7f3b6c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6b7fe700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 -- 172.21.15.43:0/564109157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 msgr2=0x7f3b6c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 0x7f3b6c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 -- 172.21.15.43:0/564109157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c1019a0 msgr2=0x7f3b6c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 -- 172.21.15.43:0/564109157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c1a0960 con 0x7f3b6c103540 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.179+0000 7f3b6bfff700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c970 tx=0x7f3b6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.180+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004a30 con 0x7f3b6c103540 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.180+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b640054f0 con 0x7f3b6c103540 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.180+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c1a0c50 con 0x7f3b6c103540 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.180+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400ec30 con 0x7f3b6c103540 2024-04-25T20:42:48.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.180+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a1140 con 0x7f3b6c103540 2024-04-25T20:42:48.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.181+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6c069760 con 0x7f3b6c103540 2024-04-25T20:42:48.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.182+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3b64004bd0 con 0x7f3b6c103540 2024-04-25T20:42:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.182+0000 7f3b68ff9700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 0x7f3b580a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:42:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.183+0000 7f3b6b7fe700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 0x7f3b580a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:42:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.183+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f3b640cf0e0 con 0x7f3b6c103540 2024-04-25T20:42:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.183+0000 7f3b6b7fe700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 0x7f3b580a6100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009fd0 tx=0x7f3b5c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:42:48.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.187+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3b6c069760 con 0x7f3b6c103540 2024-04-25T20:42:48.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:42:48.408+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3b6c06b880 con 0x7f3b580a3c40 2024-04-25T20:42:48.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:48 smithi043 ceph-mon[29167]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:48.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:48 smithi043 ceph-mon[29167]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T20:42:48.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:48 smithi043 ceph-mon[29167]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T20:42:48.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:48 smithi195 ceph-mon[33250]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:48.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:48 smithi195 ceph-mon[33250]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T20:42:48.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:48 smithi195 ceph-mon[33250]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T20:42:48.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:48 smithi112 ceph-mon[32322]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:48.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:48 smithi112 ceph-mon[32322]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T20:42:48.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:48 smithi112 ceph-mon[32322]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T20:42:49.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:49 smithi043 ceph-mon[29167]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:49.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:49 smithi043 ceph-mon[29167]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T20:42:49.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:49.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:49.771 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:49.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:49 smithi195 ceph-mon[33250]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:49 smithi195 ceph-mon[33250]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:49 smithi112 ceph-mon[32322]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:49 smithi112 ceph-mon[32322]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:42:49.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:50.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:50 smithi043 ceph-mon[29167]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:50.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:50 smithi195 ceph-mon[33250]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:50.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:50 smithi112 ceph-mon[32322]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:51.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]: dispatch 2024-04-25T20:42:51.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]': finished 2024-04-25T20:42:51.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:51 smithi043 ceph-mon[29167]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T20:42:51.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:51 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:42:51.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]: dispatch 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]': finished 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:51 smithi195 ceph-mon[33250]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:51 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]: dispatch 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2453765405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0"}]': finished 2024-04-25T20:42:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:51 smithi112 ceph-mon[32322]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T20:42:51.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:51 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:42:52.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:52 smithi043 ceph-mon[29167]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:52.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:52 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3016521394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:52.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:52 smithi195 ceph-mon[33250]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:52.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:52 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3016521394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:52.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:52 smithi112 ceph-mon[32322]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:42:52.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:52 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3016521394' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:42:54.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:54 smithi043 ceph-mon[29167]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T20:42:54.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:54 smithi195 ceph-mon[33250]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T20:42:54.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:54 smithi112 ceph-mon[32322]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-04-25T20:42:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:56 smithi043 ceph-mon[29167]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:56.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:56 smithi195 ceph-mon[33250]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:56.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:56 smithi112 ceph-mon[32322]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:42:58.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:58 smithi043 ceph-mon[29167]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:58.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:58 smithi195 ceph-mon[33250]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:58.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:58 smithi112 ceph-mon[32322]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:42:59.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T20:42:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:42:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:59.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T20:42:59.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:42:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:42:59.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T20:42:59.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:42:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:00 smithi043 ceph-mon[29167]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:00.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:00 smithi043 ceph-mon[29167]: Deploying daemon osd.6 on smithi043 2024-04-25T20:43:00.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:00 smithi195 ceph-mon[33250]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:00.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:00 smithi195 ceph-mon[33250]: Deploying daemon osd.6 on smithi043 2024-04-25T20:43:00.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:00 smithi112 ceph-mon[32322]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:00 smithi112 ceph-mon[32322]: Deploying daemon osd.6 on smithi043 2024-04-25T20:43:02.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:02 smithi043 ceph-mon[29167]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:02 smithi195 ceph-mon[33250]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:02.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:02 smithi112 ceph-mon[32322]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:43:04.696 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:04 smithi043 ceph-mon[29167]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-04-25T20:43:04.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:04 smithi195 ceph-mon[33250]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-04-25T20:43:04.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:04 smithi112 ceph-mon[32322]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-04-25T20:43:06.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:06 smithi043 ceph-mon[29167]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:06.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:06.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:06 smithi195 ceph-mon[33250]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:06.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:06 smithi112 ceph-mon[32322]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:06.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:08.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:08 smithi043 ceph-mon[29167]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:08.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:08 smithi195 ceph-mon[33250]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:08 smithi112 ceph-mon[32322]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.770+0000 7f3b68ff9700 1 -- 172.21.15.43:0/564109157 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3b6c06b880 con 0x7f3b580a3c40 2024-04-25T20:43:08.771 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 6 on host 'smithi043' 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 msgr2=0x7f3b580a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 0x7f3b580a6100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009fd0 tx=0x7f3b5c00b040 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 msgr2=0x7f3b6c1a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c970 tx=0x7f3b6400cc80 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 shutdown_connections 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3b580a3c40 0x7f3b580a6100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b6c103540 0x7f3b6c1a0290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b6c1019a0 0x7f3b6c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 --2- 172.21.15.43:0/564109157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b6c102ba0 0x7f3b6c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 >> 172.21.15.43:0/564109157 conn(0x7f3b6c0fcf40 msgr2=0x7f3b6c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 shutdown_connections 2024-04-25T20:43:08.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:43:08.773+0000 7f3b72163700 1 -- 172.21.15.43:0/564109157 wait complete. 2024-04-25T20:43:09.424 DEBUG:teuthology.orchestra.run.smithi043:osd.6> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.6.service 2024-04-25T20:43:09.426 INFO:tasks.cephadm:Deploying osd.7 on smithi112 with /dev/vg_nvme/lv_2... 2024-04-25T20:43:09.427 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T20:43:09.670 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:43:10.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:10.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T20:43:10.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.026 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T20:43:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:10.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T20:43:10.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:10.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-mon[29167]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T20:43:10.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-mon[29167]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T20:43:10.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-mon[29167]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:43:10.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:10.795 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T20:43:10.735+0000 7fc7dc53a700 -1 osd.6 0 waiting for initial osdmap 2024-04-25T20:43:10.795 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 20:43:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T20:43:10.746+0000 7fc7d832d700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:43:11.046 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:10 smithi112 ceph-mon[32322]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T20:43:11.046 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:10 smithi112 ceph-mon[32322]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T20:43:11.046 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:10 smithi112 ceph-mon[32322]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:43:11.046 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:11.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:10 smithi195 ceph-mon[33250]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T20:43:11.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:10 smithi195 ceph-mon[33250]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T20:43:11.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:10 smithi195 ceph-mon[33250]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:43:11.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:11.782 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T20:43:11.782 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T20:43:11.782 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T20:43:11.782 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T20:43:11.782 INFO:teuthology.orchestra.run.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114627 s, 915 MB/s 2024-04-25T20:43:11.783 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T20:43:11.990 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:11 smithi043 ceph-mon[29167]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:11.991 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:11 smithi043 ceph-mon[29167]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:43:11.991 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:11 smithi043 ceph-mon[29167]: osdmap e46: 7 total, 6 up, 7 in 2024-04-25T20:43:11.991 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:11.991 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:11 smithi195 ceph-mon[33250]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:11 smithi195 ceph-mon[33250]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:11 smithi195 ceph-mon[33250]: osdmap e46: 7 total, 6 up, 7 in 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:11 smithi112 ceph-mon[32322]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:11 smithi112 ceph-mon[32322]: from='osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:43:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:11 smithi112 ceph-mon[32322]: osdmap e46: 7 total, 6 up, 7 in 2024-04-25T20:43:12.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:12.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:12.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-04-25T20:43:12.654 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:43:13.007 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:12 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:43:13.007 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:12 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:43:13.008 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:12 smithi112 ceph-mon[32322]: osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] boot 2024-04-25T20:43:13.008 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:12 smithi112 ceph-mon[32322]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T20:43:13.008 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:12 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:12 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:43:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:12 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:43:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:12 smithi043 ceph-mon[29167]: osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] boot 2024-04-25T20:43:13.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:12 smithi043 ceph-mon[29167]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T20:43:13.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:12 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:12 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:43:13.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:12 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:43:13.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:12 smithi195 ceph-mon[33250]: osd.6 [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] boot 2024-04-25T20:43:13.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:12 smithi195 ceph-mon[33250]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T20:43:13.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:12 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: osdmap e48: 7 total, 7 up, 7 in 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi043 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:13.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:13.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: osdmap e48: 7 total, 7 up, 7 in 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi043 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:14.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:14.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:14.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: osdmap e48: 7 total, 7 up, 7 in 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi043 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 5697M 2024-04-25T20:43:14.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:14.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:14.270 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/959192969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68102bc0 msgr2=0x7f4b68103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/959192969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68102bc0 0x7f4b68103020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4b580099c0 tx=0x7f4b58009cd0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/959192969 shutdown_connections 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/959192969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b681019c0 0x7f4b68101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/959192969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b68103560 0x7f4b68109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.267+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/959192969 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68102bc0 0x7f4b68103020 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/959192969 >> 172.21.15.112:0/959192969 conn(0x7f4b680fcfa0 msgr2=0x7f4b680ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/959192969 shutdown_connections 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/959192969 wait complete. 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 Processor -- start 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- start start 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b681019c0 0x7f4b68197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:14.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b68102bc0 0x7f4b681980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810d610 con 0x7f4b681019c0 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810d490 con 0x7f4b68103560 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.268+0000 7f4b6f6e7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810d790 con 0x7f4b68102bc0 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51814/0 (socket says 172.21.15.112:51814) 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 -- 172.21.15.112:0/2408702602 learned_addr learned my addr 172.21.15.112:0/2408702602 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6d483700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b681019c0 0x7f4b68197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 -- 172.21.15.112:0/2408702602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b68102bc0 msgr2=0x7f4b681980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b68102bc0 0x7f4b681980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 -- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b681019c0 msgr2=0x7f4b68197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b681019c0 0x7f4b68197ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 -- 172.21.15.112:0/2408702602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6819f800 con 0x7f4b68103560 2024-04-25T20:43:14.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6dc84700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b60007d70 tx=0x7f4b6000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:43:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60016020 con 0x7f4b68103560 2024-04-25T20:43:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b6000ad40 con 0x7f4b68103560 2024-04-25T20:43:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6819faf0 con 0x7f4b68103560 2024-04-25T20:43:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b600115e0 con 0x7f4b68103560 2024-04-25T20:43:14.273 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.269+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6819ffe0 con 0x7f4b68103560 2024-04-25T20:43:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.270+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b68069730 con 0x7f4b68103560 2024-04-25T20:43:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.272+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f4b60019020 con 0x7f4b68103560 2024-04-25T20:43:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.273+0000 7f4b5e7fc700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 0x7f4b540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.273+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7f4b600cfa80 con 0x7f4b68103560 2024-04-25T20:43:14.274 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.273+0000 7f4b6d483700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 0x7f4b540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:14.275 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.273+0000 7f4b6d483700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 0x7f4b540a6100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b68102a20 tx=0x7f4b64009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:43:14.277 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.276+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b60020020 con 0x7f4b68103560 2024-04-25T20:43:14.484 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:14.483+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4b68062e80 con 0x7f4b540a3c40 2024-04-25T20:43:15.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:15.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:15.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:15.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:15.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:15.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:15.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:15.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:15.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:15 smithi043 ceph-mon[29167]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:15 smithi043 ceph-mon[29167]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:16.048 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:15 smithi112 ceph-mon[32322]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:16.048 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:15 smithi112 ceph-mon[32322]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:15 smithi195 ceph-mon[33250]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:15 smithi195 ceph-mon[33250]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:18.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/2308648766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]': finished 2024-04-25T20:43:18.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T20:43:18.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/2308648766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]': finished 2024-04-25T20:43:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T20:43:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/2308648766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]: dispatch 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c07c9491-642a-420f-b45d-5626b7539d34"}]': finished 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T20:43:18.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:19.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:18 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/2379734227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:19.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:18 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/2379734227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:19.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:18 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/2379734227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:19 smithi043 ceph-mon[29167]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:20.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:19 smithi195 ceph-mon[33250]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:19 smithi112 ceph-mon[32322]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:21 smithi043 ceph-mon[29167]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:21 smithi195 ceph-mon[33250]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:21 smithi112 ceph-mon[32322]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:23 smithi112 ceph-mon[32322]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:23 smithi043 ceph-mon[29167]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:23 smithi195 ceph-mon[33250]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:25.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:24 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T20:43:25.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:24 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:25.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:24 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T20:43:25.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:24 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:25.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:24 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T20:43:25.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:24 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:25.973 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:25 smithi112 ceph-mon[32322]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:25.973 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:25 smithi112 ceph-mon[32322]: Deploying daemon osd.7 on smithi112 2024-04-25T20:43:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:25 smithi043 ceph-mon[29167]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:26.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:25 smithi043 ceph-mon[29167]: Deploying daemon osd.7 on smithi112 2024-04-25T20:43:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:25 smithi195 ceph-mon[33250]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:26.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:25 smithi195 ceph-mon[33250]: Deploying daemon osd.7 on smithi112 2024-04-25T20:43:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:27 smithi043 ceph-mon[29167]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:27 smithi195 ceph-mon[33250]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:27 smithi112 ceph-mon[32322]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:29 smithi043 ceph-mon[29167]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:30.089 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:29 smithi112 ceph-mon[32322]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:29 smithi195 ceph-mon[33250]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:31.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:31.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:31.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:31.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:32.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:32 smithi195 ceph-mon[33250]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:32.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:32 smithi112 ceph-mon[32322]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:32.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:32 smithi043 ceph-mon[29167]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:34.004 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.003+0000 7f4b5e7fc700 1 -- 172.21.15.112:0/2408702602 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4b68062e80 con 0x7f4b540a3c40 2024-04-25T20:43:34.005 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 7 on host 'smithi112' 2024-04-25T20:43:34.006 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 msgr2=0x7f4b540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 0x7f4b540a6100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b68102a20 tx=0x7f4b64009190 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 msgr2=0x7f4b6819f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b60007d70 tx=0x7f4b6000a340 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 shutdown_connections 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b540a3c40 0x7f4b540a6100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b68103560 0x7f4b6819f160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b681019c0 0x7f4b68197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 --2- 172.21.15.112:0/2408702602 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b68102bc0 0x7f4b681980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 >> 172.21.15.112:0/2408702602 conn(0x7f4b680fcfa0 msgr2=0x7f4b68105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.005+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 shutdown_connections 2024-04-25T20:43:34.007 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:43:34.006+0000 7f4b6f6e7700 1 -- 172.21.15.112:0/2408702602 wait complete. 2024-04-25T20:43:34.587 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:34 smithi112 ceph-mon[32322]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:34.587 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:34 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.587 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:34 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.587 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:34 smithi112 ceph-mon[32322]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.587 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:34 smithi112 ceph-mon[32322]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:34 smithi195 ceph-mon[33250]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:34.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:34 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:34 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:34 smithi195 ceph-mon[33250]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:34 smithi195 ceph-mon[33250]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.613 DEBUG:teuthology.orchestra.run.smithi112:osd.7> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.7.service 2024-04-25T20:43:34.616 INFO:tasks.cephadm:Deploying osd.8 on smithi195 with /dev/vg_nvme/lv_2... 2024-04-25T20:43:34.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T20:43:34.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:34 smithi043 ceph-mon[29167]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:34.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:34 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:34 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:34.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:34 smithi043 ceph-mon[29167]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:34 smithi043 ceph-mon[29167]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T20:43:34.864 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:43:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:36.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:35 smithi043 ceph-mon[29167]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:36.063 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:35 smithi195 ceph-mon[33250]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T20:43:36.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T20:43:36.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:36.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:35 smithi112 ceph-mon[32322]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:43:36.574 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T20:43:36.428+0000 7fc6eb3f3700 -1 osd.7 0 waiting for initial osdmap 2024-04-25T20:43:36.574 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T20:43:36.437+0000 7fc6e29dd700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00846067 s, 1.2 GB/s 2024-04-25T20:43:36.966 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-25T20:43:37.266 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:36 smithi195 ceph-mon[33250]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:43:37.267 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:36 smithi195 ceph-mon[33250]: osdmap e51: 8 total, 7 up, 8 in 2024-04-25T20:43:37.267 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:36 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.267 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:36 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.267 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:36 smithi195 ceph-mon[33250]: from='osd.7 ' entity='osd.7' 2024-04-25T20:43:37.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:36 smithi043 ceph-mon[29167]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:43:37.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:36 smithi043 ceph-mon[29167]: osdmap e51: 8 total, 7 up, 8 in 2024-04-25T20:43:37.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:36 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:36 smithi043 ceph-mon[29167]: from='osd.7 ' entity='osd.7' 2024-04-25T20:43:37.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-mon[32322]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:43:37.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-mon[32322]: osdmap e51: 8 total, 7 up, 8 in 2024-04-25T20:43:37.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:37.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:36 smithi112 ceph-mon[32322]: from='osd.7 ' entity='osd.7' 2024-04-25T20:43:37.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-04-25T20:43:37.895 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:43:38.053 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:43:38.053 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:43:38.053 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:38.053 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] boot 2024-04-25T20:43:38.054 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T20:43:38.054 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:38.054 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:37 smithi112 ceph-mon[32322]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T20:43:38.231 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:43:38.231 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:43:38.231 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:38.231 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] boot 2024-04-25T20:43:38.231 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T20:43:38.232 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:38.232 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:37 smithi195 ceph-mon[33250]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T20:43:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: pgmap v177: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: osd.7 [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] boot 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:43:38.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:37 smithi043 ceph-mon[29167]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T20:43:39.297 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi112 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 5696M 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.298 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.299 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.299 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:39 smithi195 ceph-mon[33250]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T20:43:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 -- 172.21.15.195:0/1033316639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3201019c0 msgr2=0x7fe320101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:39.521 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1033316639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3201019c0 0x7fe320101de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe314009990 tx=0x7fe314009ca0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 -- 172.21.15.195:0/1033316639 shutdown_connections 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1033316639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3201019c0 0x7fe320101de0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1033316639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 0x7fe320109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1033316639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe320102bc0 0x7fe320103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 -- 172.21.15.195:0/1033316639 >> 172.21.15.195:0/1033316639 conn(0x7fe3200fcf60 msgr2=0x7fe3200ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 -- 172.21.15.195:0/1033316639 shutdown_connections 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.518+0000 7fe326d1d700 1 -- 172.21.15.195:0/1033316639 wait complete. 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 Processor -- start 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 -- start start 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3201019c0 0x7fe32006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 0x7fe32019ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:39.522 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010d570 con 0x7fe320103560 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010d3f0 con 0x7fe3201019c0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe326d1d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe32010d6f0 con 0x7fe320102bc0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34920/0 (socket says 172.21.15.195:34920) 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe31ffff700 1 -- 172.21.15.195:0/1399829889 learned_addr learned my addr 172.21.15.195:0/1399829889 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe3252ba700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 0x7fe32019ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.519+0000 7fe324ab9700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3201019c0 0x7fe32006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 -- 172.21.15.195:0/1399829889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3201019c0 msgr2=0x7fe32006bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3201019c0 0x7fe32006bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 -- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 msgr2=0x7fe32019ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 0x7fe32019ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 -- 172.21.15.195:0/1399829889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3201a08a0 con 0x7fe320102bc0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31ffff700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c920 tx=0x7fe30c00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c007b00 con 0x7fe320102bc0 2024-04-25T20:43:39.523 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe30c004d00 con 0x7fe320102bc0 2024-04-25T20:43:39.524 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3201a0b90 con 0x7fe320102bc0 2024-04-25T20:43:39.524 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c005650 con 0x7fe320102bc0 2024-04-25T20:43:39.524 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.520+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3201a1120 con 0x7fe320102bc0 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.521+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe320069730 con 0x7fe320102bc0 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.522+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe30c007ca0 con 0x7fe320102bc0 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.523+0000 7fe31dffb700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 0x7fe3100a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.523+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7fe30c0cf360 con 0x7fe320102bc0 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.523+0000 7fe324ab9700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 0x7fe3100a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:43:39.525 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.524+0000 7fe324ab9700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 0x7fe3100a6180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3140039a0 tx=0x7fe314005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:43:39.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.528+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe30c014030 con 0x7fe320102bc0 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi112 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 5696M 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:39.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:39 smithi043 ceph-mon[29167]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T20:43:39.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi112 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 5696M 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:39.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:43:39.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:39.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:39 smithi112 ceph-mon[32322]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T20:43:39.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:39.736+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe320062e80 con 0x7fe3100a3cc0 2024-04-25T20:43:40.618 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:40 smithi195 ceph-mon[33250]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:40.618 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:40 smithi195 ceph-mon[33250]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T20:43:40.618 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:40 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:40.618 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:40 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:40.619 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:40 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:40.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:40 smithi043 ceph-mon[29167]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:40.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:40 smithi043 ceph-mon[29167]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T20:43:40.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:40 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:40.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:40 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:40.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:40 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:40 smithi112 ceph-mon[32322]: pgmap v181: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:40.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:40 smithi112 ceph-mon[32322]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T20:43:40.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:40 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:43:40.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:40 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:43:40.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:40 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:41.734 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:41 smithi195 ceph-mon[33250]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:41.734 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:41 smithi195 ceph-mon[33250]: osdmap e56: 8 total, 8 up, 8 in 2024-04-25T20:43:41.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:41 smithi043 ceph-mon[29167]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:41.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:41 smithi043 ceph-mon[29167]: osdmap e56: 8 total, 8 up, 8 in 2024-04-25T20:43:41.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:41 smithi112 ceph-mon[32322]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:43:41.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:41 smithi112 ceph-mon[32322]: osdmap e56: 8 total, 8 up, 8 in 2024-04-25T20:43:42.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:42 smithi043 ceph-mon[29167]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:42.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:42 smithi195 ceph-mon[33250]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:42.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:42 smithi112 ceph-mon[32322]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 270 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:43.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/1160691697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]': finished 2024-04-25T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:43 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/627394179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/1160691697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]': finished 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:43 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/627394179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:43.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/1160691697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]: dispatch 2024-04-25T20:43:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "105fc845-edce-449f-884a-2fa640a599f7"}]': finished 2024-04-25T20:43:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T20:43:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:43:43.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:43 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/627394179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:43:44.743 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:44 smithi195 ceph-mon[33250]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:44.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:44 smithi043 ceph-mon[29167]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:44 smithi112 ceph-mon[32322]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:46.590 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:46 smithi195 ceph-mon[33250]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:46 smithi043 ceph-mon[29167]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:46.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:46 smithi112 ceph-mon[32322]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:48.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:48 smithi043 ceph-mon[29167]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:48.797 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:48 smithi195 ceph-mon[33250]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:48.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:48 smithi112 ceph-mon[32322]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:50.762 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:50 smithi195 ceph-mon[33250]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:50.762 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T20:43:50.762 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:50.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:50 smithi043 ceph-mon[29167]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:50.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T20:43:50.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:50.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:50 smithi112 ceph-mon[32322]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:50.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T20:43:50.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:43:51.781 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:51 smithi195 ceph-mon[33250]: Deploying daemon osd.8 on smithi195 2024-04-25T20:43:51.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:51 smithi043 ceph-mon[29167]: Deploying daemon osd.8 on smithi195 2024-04-25T20:43:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:51 smithi112 ceph-mon[32322]: Deploying daemon osd.8 on smithi195 2024-04-25T20:43:52.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:52 smithi043 ceph-mon[29167]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:52.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:52 smithi195 ceph-mon[33250]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:52.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:52 smithi112 ceph-mon[32322]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:54.753 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:54 smithi195 ceph-mon[33250]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:54.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:54 smithi043 ceph-mon[29167]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:54.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:54 smithi112 ceph-mon[32322]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:56.703 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:56 smithi195 ceph-mon[33250]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:56.703 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.703 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.703 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:56 smithi043 ceph-mon[29167]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:56.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:56 smithi112 ceph-mon[32322]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:56.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:43:56.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:43:58.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:43:58 smithi043 ceph-mon[29167]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:58.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:43:58 smithi195 ceph-mon[33250]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:58.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:43:58 smithi112 ceph-mon[32322]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:43:59.308 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.307+0000 7fe31dffb700 1 -- 172.21.15.195:0/1399829889 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe320062e80 con 0x7fe3100a3cc0 2024-04-25T20:43:59.308 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 8 on host 'smithi195' 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 msgr2=0x7fe3100a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 0x7fe3100a6180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3140039a0 tx=0x7fe314005fb0 comp rx=0 tx=0).stop 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 msgr2=0x7fe32019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c920 tx=0x7fe30c00cc30 comp rx=0 tx=0).stop 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 shutdown_connections 2024-04-25T20:43:59.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe3100a3cc0 0x7fe3100a6180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe320103560 0x7fe32019ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe3201019c0 0x7fe32006bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 --2- 172.21.15.195:0/1399829889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe320102bc0 0x7fe32019d990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 >> 172.21.15.195:0/1399829889 conn(0x7fe3200fcf60 msgr2=0x7fe320105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 shutdown_connections 2024-04-25T20:43:59.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:43:59.311+0000 7fe326d1d700 1 -- 172.21.15.195:0/1399829889 wait complete. 2024-04-25T20:43:59.966 DEBUG:teuthology.orchestra.run.smithi195:osd.8> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.8.service 2024-04-25T20:43:59.969 INFO:tasks.cephadm:Deploying osd.9 on smithi043 with /dev/vg_nvme/lv_1... 2024-04-25T20:43:59.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T20:44:00.229 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.523 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:00 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:00.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:00 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T20:44:00.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:00.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:00 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:01.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:01 smithi043 ceph-mon[29167]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:01 smithi043 ceph-mon[29167]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:01 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:01 smithi043 ceph-mon[29167]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:01 smithi043 ceph-mon[29167]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:01.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-mon[33250]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-mon[33250]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-mon[33250]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-mon[33250]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:01 smithi112 ceph-mon[32322]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:01 smithi112 ceph-mon[32322]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:01 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:01.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:01 smithi112 ceph-mon[32322]: from='osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:01 smithi112 ceph-mon[32322]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:44:02.126 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T20:44:01.923+0000 7f9ee6c6a700 -1 osd.8 0 waiting for initial osdmap 2024-04-25T20:44:02.127 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 20:44:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T20:44:01.934+0000 7f9edea55700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr: stderr: 10+0 records in 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:10+0 records out 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0083674 s, 1.3 GB/s 2024-04-25T20:44:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:--> Zapping successful for: 2024-04-25T20:44:02.788 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: osdmap e59: 9 total, 8 up, 9 in 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: from='osd.8 ' entity='osd.8' 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] boot 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T20:44:02.789 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:44:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: osdmap e59: 9 total, 8 up, 9 in 2024-04-25T20:44:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: from='osd.8 ' entity='osd.8' 2024-04-25T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] boot 2024-04-25T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: osdmap e59: 9 total, 8 up, 9 in 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: from='osd.8 ' entity='osd.8' 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: osd.8 [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] boot 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T20:44:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:44:03.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi043:vg_nvme/lv_1 2024-04-25T20:44:03.624 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:44:03.750 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:03 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:44:03.750 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:03 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:44:03.751 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:03 smithi043 ceph-mon[29167]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:03.751 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:03 smithi043 ceph-mon[29167]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T20:44:03.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:03 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:03 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:03 smithi195 ceph-mon[33250]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:03 smithi195 ceph-mon[33250]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:03 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:03 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:03 smithi112 ceph-mon[32322]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:03 smithi112 ceph-mon[32322]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi195 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 5696M 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:04.760 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:04.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:04.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:04.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:04 smithi043 ceph-mon[29167]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi195 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 5696M 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:04 smithi195 ceph-mon[33250]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi195 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 5696M 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:04 smithi112 ceph-mon[32322]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 -- 172.21.15.43:0/3489939471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101320 msgr2=0x7f0c00101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 --2- 172.21.15.43:0/3489939471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101320 0x7f0c00101740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009990 tx=0x7f0bf0009ca0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 -- 172.21.15.43:0/3489939471 shutdown_connections 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 --2- 172.21.15.43:0/3489939471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00102640 0x7f0c00102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 --2- 172.21.15.43:0/3489939471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101320 0x7f0c00101740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 --2- 172.21.15.43:0/3489939471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00101c80 0x7f0c00102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 -- 172.21.15.43:0/3489939471 >> 172.21.15.43:0/3489939471 conn(0x7f0c000fcf40 msgr2=0x7f0c000ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 -- 172.21.15.43:0/3489939471 shutdown_connections 2024-04-25T20:44:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.270+0000 7f0c07115700 1 -- 172.21.15.43:0/3489939471 wait complete. 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 Processor -- start 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 -- start start 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00101320 0x7f0c0019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00102640 0x7f0c001a2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c00110850 con 0x7f0c00101c80 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c001106d0 con 0x7f0c00102640 2024-04-25T20:44:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c07115700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0c001109d0 con 0x7f0c00101320 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43002/0 (socket says 172.21.15.43:43002) 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 -- 172.21.15.43:0/1964750351 learned_addr learned my addr 172.21.15.43:0/1964750351 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c04eb1700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00101320 0x7f0c0019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0c056b2700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00102640 0x7f0c001a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 -- 172.21.15.43:0/1964750351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00101320 msgr2=0x7f0c0019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00101320 0x7f0c0019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 -- 172.21.15.43:0/1964750351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00102640 msgr2=0x7f0c001a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00102640 0x7f0c001a2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.271+0000 7f0bfffff700 1 -- 172.21.15.43:0/1964750351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c001a2af0 con 0x7f0c00101c80 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0bfffff700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c9e0 tx=0x7f0bf400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4007ac0 con 0x7f0c00101c80 2024-04-25T20:44:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0bf4007c60 con 0x7f0c00101c80 2024-04-25T20:44:05.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c001a2de0 con 0x7f0c00101c80 2024-04-25T20:44:05.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4018660 con 0x7f0c00101c80 2024-04-25T20:44:05.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.272+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001a3290 con 0x7f0c00101c80 2024-04-25T20:44:05.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.273+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c00069730 con 0x7f0c00101c80 2024-04-25T20:44:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.274+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0bf400f450 con 0x7f0c00101c80 2024-04-25T20:44:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.275+0000 7f0bfdffb700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 0x7f0be80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.275+0000 7f0c04eb1700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 0x7f0be80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.275+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5858+0+0 (secure 0 0 0) 0x7f0bf40cfa00 con 0x7f0c00101c80 2024-04-25T20:44:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.275+0000 7f0c04eb1700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 0x7f0be80a6100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b5c0 tx=0x7f0bf0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:05.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.280+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0bf4014030 con 0x7f0c00101c80 2024-04-25T20:44:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:05.500+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0c00062e80 con 0x7f0be80a3c40 2024-04-25T20:44:06.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:06 smithi043 ceph-mon[29167]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:06 smithi043 ceph-mon[29167]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T20:44:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:06.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:06 smithi195 ceph-mon[33250]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:06 smithi195 ceph-mon[33250]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:06 smithi112 ceph-mon[32322]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:06 smithi112 ceph-mon[32322]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T20:44:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:06.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:06.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:07.693 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:07 smithi043 ceph-mon[29167]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:07.693 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:07 smithi043 ceph-mon[29167]: osdmap e64: 9 total, 9 up, 9 in 2024-04-25T20:44:07.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:07 smithi195 ceph-mon[33250]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:07.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:07 smithi195 ceph-mon[33250]: osdmap e64: 9 total, 9 up, 9 in 2024-04-25T20:44:07.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:07 smithi112 ceph-mon[32322]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi043:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:07.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:07 smithi112 ceph-mon[32322]: osdmap e64: 9 total, 9 up, 9 in 2024-04-25T20:44:08.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:08 smithi043 ceph-mon[29167]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:08.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:08 smithi195 ceph-mon[33250]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:08.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:08 smithi112 ceph-mon[32322]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 301 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:09.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]: dispatch 2024-04-25T20:44:09.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]': finished 2024-04-25T20:44:09.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:09 smithi043 ceph-mon[29167]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T20:44:09.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:09.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2452604774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:09.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]: dispatch 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]': finished 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:09 smithi195 ceph-mon[33250]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2452604774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]: dispatch 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3823986216' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f53017-0b8d-48a7-90cb-2b42a124b861"}]': finished 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:09 smithi112 ceph-mon[32322]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T20:44:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:09.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2452604774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:10.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:10 smithi043 ceph-mon[29167]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-25T20:44:10.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:10 smithi195 ceph-mon[33250]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-25T20:44:10.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:10 smithi112 ceph-mon[32322]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-04-25T20:44:12.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:12 smithi043 ceph-mon[29167]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T20:44:12.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:12 smithi195 ceph-mon[33250]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T20:44:12.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:12 smithi112 ceph-mon[32322]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T20:44:14.764 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:14 smithi043 ceph-mon[29167]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:44:14.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:14 smithi195 ceph-mon[33250]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:44:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:14 smithi112 ceph-mon[32322]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-25T20:44:16.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:16 smithi043 ceph-mon[29167]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:44:16.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T20:44:16.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:16.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:16 smithi195 ceph-mon[33250]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:44:16.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T20:44:16.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:16.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:16 smithi112 ceph-mon[32322]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-25T20:44:16.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T20:44:16.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:17.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:17 smithi043 ceph-mon[29167]: Deploying daemon osd.9 on smithi043 2024-04-25T20:44:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:17 smithi195 ceph-mon[33250]: Deploying daemon osd.9 on smithi043 2024-04-25T20:44:17.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:17 smithi112 ceph-mon[32322]: Deploying daemon osd.9 on smithi043 2024-04-25T20:44:18.611 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:18 smithi043 ceph-mon[29167]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:44:18.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:18 smithi195 ceph-mon[33250]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:44:18.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:18 smithi112 ceph-mon[32322]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:44:20.672 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:20 smithi043 ceph-mon[29167]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:20.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:20 smithi195 ceph-mon[33250]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:20.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:20 smithi112 ceph-mon[32322]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:22.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:22 smithi043 ceph-mon[29167]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:22.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:22 smithi195 ceph-mon[33250]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:22 smithi112 ceph-mon[32322]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:23 smithi043 ceph-mon[29167]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:23.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:23 smithi195 ceph-mon[33250]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:23 smithi112 ceph-mon[32322]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:25.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:25 smithi043 ceph-mon[29167]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:25 smithi195 ceph-mon[33250]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:25 smithi112 ceph-mon[32322]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:26.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.664+0000 7f0bfdffb700 1 -- 172.21.15.43:0/1964750351 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c00062e80 con 0x7f0be80a3c40 2024-04-25T20:44:26.667 INFO:teuthology.orchestra.run.smithi043.stdout:Created osd(s) 9 on host 'smithi043' 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 msgr2=0x7f0be80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 0x7f0be80a6100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b5c0 tx=0x7f0bf0005fb0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 msgr2=0x7f0c0019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400c9e0 tx=0x7f0bf400ccf0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 shutdown_connections 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0be80a3c40 0x7f0be80a6100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c00101320 0x7f0c0019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c00102640 0x7f0c001a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 --2- 172.21.15.43:0/1964750351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c00101c80 0x7f0c0019b3d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:26.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 >> 172.21.15.43:0/1964750351 conn(0x7f0c000fcf40 msgr2=0x7f0c000fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:44:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 shutdown_connections 2024-04-25T20:44:26.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:44:26.666+0000 7f0c07115700 1 -- 172.21.15.43:0/1964750351 wait complete. 2024-04-25T20:44:27.034 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.034 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.034 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.035 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:27.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:27.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:27.507 DEBUG:teuthology.orchestra.run.smithi043:osd.9> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.9.service 2024-04-25T20:44:27.510 INFO:tasks.cephadm:Deploying osd.10 on smithi112 with /dev/vg_nvme/lv_1... 2024-04-25T20:44:27.510 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T20:44:27.754 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:44:27.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:27 smithi112 ceph-mon[32322]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:27.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:27 smithi112 ceph-mon[32322]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T20:44:27.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:27 smithi112 ceph-mon[32322]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T20:44:27.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:27 smithi112 ceph-mon[32322]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:44:27.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:27 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-mon[29167]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-mon[29167]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T20:44:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-mon[29167]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T20:44:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-mon[29167]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:44:28.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:28.045 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T20:44:27.745+0000 7fc78e182700 -1 osd.9 0 waiting for initial osdmap 2024-04-25T20:44:28.045 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 20:44:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T20:44:27.756+0000 7fc789f75700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:44:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:27 smithi195 ceph-mon[33250]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:27 smithi195 ceph-mon[33250]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T20:44:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:27 smithi195 ceph-mon[33250]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T20:44:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:27 smithi195 ceph-mon[33250]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]: dispatch 2024-04-25T20:44:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:27 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:28 smithi112 ceph-mon[32322]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:44:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:28 smithi112 ceph-mon[32322]: osdmap e67: 10 total, 9 up, 10 in 2024-04-25T20:44:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:29.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:28 smithi043 ceph-mon[29167]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:44:29.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:28 smithi043 ceph-mon[29167]: osdmap e67: 10 total, 9 up, 10 in 2024-04-25T20:44:29.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:29.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:28 smithi195 ceph-mon[33250]: from='osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi043", "root=default"]}]': finished 2024-04-25T20:44:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:28 smithi195 ceph-mon[33250]: osdmap e67: 10 total, 9 up, 10 in 2024-04-25T20:44:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:29.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10+0 records in 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:10+0 records out 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114428 s, 916 MB/s 2024-04-25T20:44:29.790 INFO:teuthology.orchestra.run.smithi112.stderr:--> Zapping successful for: 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] boot 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T20:44:30.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:29 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] boot 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T20:44:30.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:29 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: osd.9 [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] boot 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T20:44:30.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:29 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:44:30.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2024-04-25T20:44:30.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:30 smithi112 ceph-mon[32322]: osdmap e69: 10 total, 10 up, 10 in 2024-04-25T20:44:30.868 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T20:44:31.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:30 smithi043 ceph-mon[29167]: osdmap e69: 10 total, 10 up, 10 in 2024-04-25T20:44:31.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:30 smithi195 ceph-mon[33250]: osdmap e69: 10 total, 10 up, 10 in 2024-04-25T20:44:32.255 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:32.255 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi043 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:32.256 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi043 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi043 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 4273M 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:32.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:32.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:32.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 -- 172.21.15.112:0/2507847328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0102ba0 msgr2=0x7efcb0103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 --2- 172.21.15.112:0/2507847328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0102ba0 0x7efcb0103000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0099c0 tx=0x7efc9c009cd0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 -- 172.21.15.112:0/2507847328 shutdown_connections 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 --2- 172.21.15.112:0/2507847328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb0103540 0x7efcb0109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 --2- 172.21.15.112:0/2507847328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb01019a0 0x7efcb0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 --2- 172.21.15.112:0/2507847328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0102ba0 0x7efcb0103000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 -- 172.21.15.112:0/2507847328 >> 172.21.15.112:0/2507847328 conn(0x7efcb00fcf40 msgr2=0x7efcb00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 -- 172.21.15.112:0/2507847328 shutdown_connections 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.608+0000 7efcb6fde700 1 -- 172.21.15.112:0/2507847328 wait complete. 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 Processor -- start 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 -- start start 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb01019a0 0x7efcb0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:32.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb0102ba0 0x7efcb01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efcb010d550 con 0x7efcb0102ba0 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcb010d3d0 con 0x7efcb0103540 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb6fde700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efcb010d6d0 con 0x7efcb01019a0 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:51352/0 (socket says 172.21.15.112:51352) 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 -- 172.21.15.112:0/1622984911 learned_addr learned my addr 172.21.15.112:0/1622984911 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb4d7a700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb01019a0 0x7efcb0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcaffff700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb0102ba0 0x7efcb01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 -- 172.21.15.112:0/1622984911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb01019a0 msgr2=0x7efcb0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb01019a0 0x7efcb0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 -- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb0102ba0 msgr2=0x7efcb01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb0102ba0 0x7efcb01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.609+0000 7efcb557b700 1 -- 172.21.15.112:0/1622984911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb01a0950 con 0x7efcb0103540 2024-04-25T20:44:32.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcb557b700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efca8007ee0 tx=0x7efca800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:32.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca800dd20 con 0x7efcb0103540 2024-04-25T20:44:32.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efca8004020 con 0x7efcb0103540 2024-04-25T20:44:32.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb01a0c40 con 0x7efcb0103540 2024-04-25T20:44:32.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8015660 con 0x7efcb0103540 2024-04-25T20:44:32.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.610+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb01a1180 con 0x7efcb0103540 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.611+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb0069730 con 0x7efcb0103540 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.612+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7efca80041d0 con 0x7efcb0103540 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.613+0000 7efcadffb700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 0x7efca00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.613+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7efca80cf4e0 con 0x7efcb0103540 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.613+0000 7efcb4d7a700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 0x7efca00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:32.615 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.613+0000 7efcb4d7a700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 0x7efca00a6100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efcb0102a00 tx=0x7efca400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:32.618 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.617+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efca8010070 con 0x7efcb0103540 2024-04-25T20:44:32.821 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:32.820+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7efcb00ff120 con 0x7efca00a3c40 2024-04-25T20:44:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:33.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:33.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:33.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:33.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:33.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:33.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:34.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:33 smithi043 ceph-mon[29167]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:34.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:33 smithi043 ceph-mon[29167]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:33 smithi195 ceph-mon[33250]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:33 smithi195 ceph-mon[33250]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:33 smithi112 ceph-mon[32322]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:33 smithi112 ceph-mon[32322]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/1416110132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]': finished 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T20:44:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/1416110132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]': finished 2024-04-25T20:44:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T20:44:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/1416110132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]: dispatch 2024-04-25T20:44:36.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa850133-269d-405c-a1a2-64122432d80a"}]': finished 2024-04-25T20:44:36.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T20:44:36.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:37.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:36 smithi043 ceph-mon[29167]: from='client.? 172.21.15.112:0/1021773841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:37.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:36 smithi195 ceph-mon[33250]: from='client.? 172.21.15.112:0/1021773841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:37.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:36 smithi112 ceph-mon[32322]: from='client.? 172.21.15.112:0/1021773841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:44:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:37 smithi043 ceph-mon[29167]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:37 smithi195 ceph-mon[33250]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:37 smithi112 ceph-mon[32322]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:40.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:39 smithi043 ceph-mon[29167]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:39 smithi195 ceph-mon[33250]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:39 smithi112 ceph-mon[32322]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:42.290 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:41 smithi112 ceph-mon[32322]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:41 smithi043 ceph-mon[29167]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:41 smithi195 ceph-mon[33250]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:44.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:43 smithi043 ceph-mon[29167]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T20:44:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:44 smithi043 ceph-mon[29167]: Deploying daemon osd.10 on smithi112 2024-04-25T20:44:44.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:44 smithi195 ceph-mon[33250]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:44.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:44 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T20:44:44.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:44 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:44.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:44 smithi195 ceph-mon[33250]: Deploying daemon osd.10 on smithi112 2024-04-25T20:44:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:44 smithi112 ceph-mon[32322]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:44 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T20:44:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:44 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:44 smithi112 ceph-mon[32322]: Deploying daemon osd.10 on smithi112 2024-04-25T20:44:46.263 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:46 smithi112 ceph-mon[32322]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:46.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:46 smithi043 ceph-mon[29167]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:46 smithi195 ceph-mon[33250]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:48.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:48 smithi043 ceph-mon[29167]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:48 smithi195 ceph-mon[33250]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:48.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:48 smithi112 ceph-mon[32322]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:50.006 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.006 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.006 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:49 smithi112 ceph-mon[32322]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:50.006 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:49 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:49 smithi043 ceph-mon[29167]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:50.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:49 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:50.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:49 smithi195 ceph-mon[33250]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:50.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:49 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:51 smithi043 ceph-mon[29167]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:51 smithi195 ceph-mon[33250]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:51 smithi112 ceph-mon[32322]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:52.544 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 10 on host 'smithi112' 2024-04-25T20:44:52.544 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.542+0000 7efcadffb700 1 -- 172.21.15.112:0/1622984911 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7efcb00ff120 con 0x7efca00a3c40 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.544+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 msgr2=0x7efca00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.544+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 0x7efca00a6100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efcb0102a00 tx=0x7efca400a380 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.544+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 msgr2=0x7efcb01a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efca8007ee0 tx=0x7efca800d3b0 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 shutdown_connections 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efca00a3c40 0x7efca00a6100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efcb01019a0 0x7efcb0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcb0103540 0x7efcb01a02b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 --2- 172.21.15.112:0/1622984911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcb0102ba0 0x7efcb01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 >> 172.21.15.112:0/1622984911 conn(0x7efcb00fcf40 msgr2=0x7efcb00fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:44:52.546 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 shutdown_connections 2024-04-25T20:44:52.547 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-25T20:44:52.545+0000 7efcb6fde700 1 -- 172.21.15.112:0/1622984911 wait complete. 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:52 smithi043 ceph-mon[29167]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:52 smithi195 ceph-mon[33250]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:52 smithi112 ceph-mon[32322]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T20:44:53.204 DEBUG:teuthology.orchestra.run.smithi112:osd.10> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.10.service 2024-04-25T20:44:53.207 INFO:tasks.cephadm:Deploying osd.11 on smithi195 with /dev/vg_nvme/lv_1... 2024-04-25T20:44:53.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T20:44:53.454 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:44:53.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:53.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T20:44:53.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T20:44:53.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:53.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:53.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:53 smithi195 ceph-mon[33250]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T20:44:54.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T20:44:54.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:54.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:54.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:53 smithi112 ceph-mon[32322]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:54.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:54.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T20:44:54.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T20:44:54.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:54.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: from='osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:54.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:53 smithi043 ceph-mon[29167]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-04-25T20:44:54.965 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 20:44:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T20:44:54.951+0000 7f2760344700 -1 osd.10 0 waiting for initial osdmap 2024-04-25T20:44:54.965 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 20:44:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T20:44:54.962+0000 7f275812f700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120102 s, 873 MB/s 2024-04-25T20:44:55.569 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-04-25T20:44:55.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:44:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: osdmap e72: 11 total, 10 up, 11 in 2024-04-25T20:44:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:55.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:55 smithi043 ceph-mon[29167]: from='osd.10 ' entity='osd.10' 2024-04-25T20:44:55.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: osdmap e72: 11 total, 10 up, 11 in 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:55 smithi195 ceph-mon[33250]: from='osd.10 ' entity='osd.10' 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: osdmap e72: 11 total, 10 up, 11 in 2024-04-25T20:44:55.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:55.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-04-25T20:44:55.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:55 smithi112 ceph-mon[32322]: from='osd.10 ' entity='osd.10' 2024-04-25T20:44:56.354 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2024-04-25T20:44:56.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] boot 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi112 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 4272M 2024-04-25T20:44:56.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] boot 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi112 2024-04-25T20:44:56.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 4272M 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:56.594 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.597 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:44:56.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: osd.10 [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] boot 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi112 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 4272M 2024-04-25T20:44:56.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:56.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:56.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:44:56.796 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:44:57.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:57 smithi043 ceph-mon[29167]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T20:44:57.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:57 smithi043 ceph-mon[29167]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:57.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:57 smithi195 ceph-mon[33250]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T20:44:57.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:57 smithi195 ceph-mon[33250]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:57.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:57 smithi112 ceph-mon[32322]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T20:44:57.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:57 smithi112 ceph-mon[32322]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:58.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/1336954278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb8103540 msgr2=0x7f2cb8109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:58.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/1336954278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb8103540 0x7f2cb8109df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000b0a0 tx=0x7f2cb000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/1336954278 shutdown_connections 2024-04-25T20:44:58.456 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/1336954278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb8103540 0x7f2cb8109df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/1336954278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb81019a0 0x7f2cb8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/1336954278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 0x7f2cb8103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/1336954278 >> 172.21.15.195:0/1336954278 conn(0x7f2cb80fcf40 msgr2=0x7f2cb80ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/1336954278 shutdown_connections 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.453+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/1336954278 wait complete. 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 Processor -- start 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 -- start start 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 0x7f2cb819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 0x7f2cb81a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810d580 con 0x7f2cb8102ba0 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810d400 con 0x7f2cb8103540 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbf1dd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810d700 con 0x7f2cb81019a0 2024-04-25T20:44:58.457 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:57188/0 (socket says 172.21.15.195:57188) 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 -- 172.21.15.195:0/976216201 learned_addr learned my addr 172.21.15.195:0/976216201 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cb7fff700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 0x7f2cb819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbd77a700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 0x7f2cb81a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 -- 172.21.15.195:0/976216201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 msgr2=0x7f2cb81a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 0x7f2cb81a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 -- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 msgr2=0x7f2cb819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 0x7f2cb819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbcf79700 1 -- 172.21.15.195:0/976216201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb81a2b20 con 0x7f2cb81019a0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.454+0000 7f2cbd77a700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 0x7f2cb81a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cbcf79700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c8f0 tx=0x7f2cac00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac004220 con 0x7f2cb81019a0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb81a2e10 con 0x7f2cb81019a0 2024-04-25T20:44:58.458 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2cac0043c0 con 0x7f2cb81019a0 2024-04-25T20:44:58.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac003d10 con 0x7f2cb81019a0 2024-04-25T20:44:58.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.455+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb81a3270 con 0x7f2cb81019a0 2024-04-25T20:44:58.459 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.456+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb8069730 con 0x7f2cb81019a0 2024-04-25T20:44:58.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.458+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2cac007740 con 0x7f2cb81019a0 2024-04-25T20:44:58.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.458+0000 7f2cb5ffb700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 0x7f2ca80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:44:58.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.458+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6723+0+0 (secure 0 0 0) 0x7f2cac0cfa00 con 0x7f2cb81019a0 2024-04-25T20:44:58.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.458+0000 7f2cb7fff700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 0x7f2ca80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:44:58.460 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.459+0000 7f2cb7fff700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 0x7f2ca80a6100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cb806b800 tx=0x7f2ca400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:44:58.464 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.463+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2cac014030 con 0x7f2cb81019a0 2024-04-25T20:44:58.675 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:44:58.674+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2cb8062e80 con 0x7f2ca80a3c40 2024-04-25T20:44:58.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:58 smithi043 ceph-mon[29167]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T20:44:58.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:58 smithi195 ceph-mon[33250]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T20:44:58.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:58 smithi112 ceph-mon[32322]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T20:44:59.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T20:44:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:59.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:44:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:44:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:44:59.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T20:44:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:44:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:44:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T20:44:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T20:44:59.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:44:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:00.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:00 smithi195 ceph-mon[33250]: osdmap e77: 11 total, 11 up, 11 in 2024-04-25T20:45:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:00 smithi043 ceph-mon[29167]: osdmap e77: 11 total, 11 up, 11 in 2024-04-25T20:45:00.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:00 smithi112 ceph-mon[32322]: osdmap e77: 11 total, 11 up, 11 in 2024-04-25T20:45:01.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/502196196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]': finished 2024-04-25T20:45:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T20:45:01.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:01 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/502196196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]': finished 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T20:45:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:01 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/502196196' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]: dispatch 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3"}]': finished 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T20:45:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:01 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:02.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:02 smithi043 ceph-mon[29167]: from='client.? 172.21.15.195:0/1068224017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:45:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:02 smithi195 ceph-mon[33250]: from='client.? 172.21.15.195:0/1068224017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:45:02.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:02 smithi112 ceph-mon[32322]: from='client.? 172.21.15.195:0/1068224017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T20:45:03.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:03 smithi195 ceph-mon[33250]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-04-25T20:45:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:03 smithi112 ceph-mon[32322]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-04-25T20:45:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:03 smithi043 ceph-mon[29167]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-04-25T20:45:05.994 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:05 smithi195 ceph-mon[33250]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-25T20:45:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:05 smithi043 ceph-mon[29167]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-25T20:45:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:05 smithi112 ceph-mon[32322]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-25T20:45:07.935 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:07 smithi195 ceph-mon[33250]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T20:45:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:07 smithi043 ceph-mon[29167]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T20:45:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:07 smithi112 ceph-mon[32322]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T20:45:10.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:09 smithi195 ceph-mon[33250]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T20:45:10.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T20:45:10.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:09 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:10.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:09 smithi195 ceph-mon[33250]: Deploying daemon osd.11 on smithi195 2024-04-25T20:45:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:09 smithi043 ceph-mon[29167]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T20:45:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T20:45:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:09 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:09 smithi043 ceph-mon[29167]: Deploying daemon osd.11 on smithi195 2024-04-25T20:45:10.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:09 smithi112 ceph-mon[32322]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-25T20:45:10.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T20:45:10.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:09 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:10.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:09 smithi112 ceph-mon[32322]: Deploying daemon osd.11 on smithi195 2024-04-25T20:45:11.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:11 smithi195 ceph-mon[33250]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:45:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:11 smithi043 ceph-mon[29167]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:45:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:11 smithi112 ceph-mon[32322]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T20:45:13.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:13 smithi195 ceph-mon[33250]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-25T20:45:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:13 smithi043 ceph-mon[29167]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-25T20:45:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:13 smithi112 ceph-mon[32322]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-25T20:45:16.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:16 smithi043 ceph-mon[29167]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:16.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:16.796 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:16 smithi112 ceph-mon[32322]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:16.796 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.796 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.796 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:16.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:16 smithi195 ceph-mon[33250]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:16.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:16.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:18.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:18 smithi195 ceph-mon[33250]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:18.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:18 smithi043 ceph-mon[29167]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:18.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:18 smithi112 ceph-mon[32322]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:19.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.349+0000 7f2cb5ffb700 1 -- 172.21.15.195:0/976216201 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2cb8062e80 con 0x7f2ca80a3c40 2024-04-25T20:45:19.350 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 11 on host 'smithi195' 2024-04-25T20:45:19.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 msgr2=0x7f2ca80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:19.352 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 0x7f2ca80a6100 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cb806b800 tx=0x7f2ca400b410 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 msgr2=0x7f2cb806b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c8f0 tx=0x7f2cac00cc00 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 shutdown_connections 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f2ca80a3c40 0x7f2ca80a6100 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb81019a0 0x7f2cb806b280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2cb8103540 0x7f2cb81a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 --2- 172.21.15.195:0/976216201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cb8102ba0 0x7f2cb819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 >> 172.21.15.195:0/976216201 conn(0x7f2cb80fcf40 msgr2=0x7f2cb8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 shutdown_connections 2024-04-25T20:45:19.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:19.351+0000 7f2cbf1dd700 1 -- 172.21.15.195:0/976216201 wait complete. 2024-04-25T20:45:19.814 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.815 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:19 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:19.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:19 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:20.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:19 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:20.135 DEBUG:teuthology.orchestra.run.smithi195:osd.11> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.11.service 2024-04-25T20:45:20.137 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-25T20:45:20.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T20:45:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:20.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:20 smithi195 ceph-mon[33250]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T20:45:20.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:20 smithi195 ceph-mon[33250]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:20.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:20 smithi195 ceph-mon[33250]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T20:45:20.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:20.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:20 smithi195 ceph-mon[33250]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:20 smithi043 ceph-mon[29167]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T20:45:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:20 smithi043 ceph-mon[29167]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:20 smithi043 ceph-mon[29167]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T20:45:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:20 smithi043 ceph-mon[29167]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:20 smithi112 ceph-mon[32322]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T20:45:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:20 smithi112 ceph-mon[32322]: from='osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:20 smithi112 ceph-mon[32322]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T20:45:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:20 smithi112 ceph-mon[32322]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-04-25T20:45:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T20:45:20.998+0000 7f1fae67d700 -1 osd.11 0 waiting for initial osdmap 2024-04-25T20:45:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T20:45:21.012+0000 7f1fa5c67700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: osdmap e80: 12 total, 11 up, 12 in 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:21.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:21 smithi195 ceph-mon[33250]: from='osd.11 ' entity='osd.11' 2024-04-25T20:45:21.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:45:21.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: osdmap e80: 12 total, 11 up, 12 in 2024-04-25T20:45:21.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:21.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:21 smithi043 ceph-mon[29167]: from='osd.11 ' entity='osd.11' 2024-04-25T20:45:21.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-04-25T20:45:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: osdmap e80: 12 total, 11 up, 12 in 2024-04-25T20:45:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-25T20:45:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:21 smithi112 ceph-mon[32322]: from='osd.11 ' entity='osd.11' 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.420+0000 7f0bec70d700 1 -- 172.21.15.43:0/3402127636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 msgr2=0x7f0be4104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.420+0000 7f0bec70d700 1 --2- 172.21.15.43:0/3402127636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4104120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40099c0 tx=0x7f0bd4009cd0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- 172.21.15.43:0/3402127636 shutdown_connections 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- 172.21.15.43:0/3402127636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4104660 0x7f0be410af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- 172.21.15.43:0/3402127636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4102ac0 0x7f0be4102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- 172.21.15.43:0/3402127636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4104120 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- 172.21.15.43:0/3402127636 >> 172.21.15.43:0/3402127636 conn(0x7f0be40fe060 msgr2=0x7f0be41004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- 172.21.15.43:0/3402127636 shutdown_connections 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- 172.21.15.43:0/3402127636 wait complete. 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 Processor -- start 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- start start 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4104660 0x7f0be4075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e670 con 0x7f0be4103cc0 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e4f0 con 0x7f0be4104660 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.421+0000 7f0bec70d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0be410e7f0 con 0x7f0be4102ac0 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0be9ca8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:56408/0 (socket says 172.21.15.43:56408) 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 -- 172.21.15.43:0/2752195201 learned_addr learned my addr 172.21.15.43:0/2752195201 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0beacaa700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4104660 0x7f0be4075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 -- 172.21.15.43:0/2752195201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4104660 msgr2=0x7f0be4075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4104660 0x7f0be4075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 -- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 msgr2=0x7f0be4074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 -- 172.21.15.43:0/2752195201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be4075c20 con 0x7f0be4102ac0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0be9ca8700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bea4a9700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0be000d980 tx=0x7f0be000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0017030 con 0x7f0be4102ac0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be41a2e40 con 0x7f0be4102ac0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0be00044f0 con 0x7f0be4102ac0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0003aa0 con 0x7f0be4102ac0 2024-04-25T20:45:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.422+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be41a3240 con 0x7f0be4102ac0 2024-04-25T20:45:22.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.423+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be402df80 con 0x7f0be4102ac0 2024-04-25T20:45:22.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.424+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0be001a070 con 0x7f0be4102ac0 2024-04-25T20:45:22.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.425+0000 7f0bdb7fe700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 0x7f0bd00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.425+0000 7f0be9ca8700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 0x7f0bd00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.425+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0be00cf8d0 con 0x7f0be4102ac0 2024-04-25T20:45:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.426+0000 7f0be9ca8700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 0x7f0bd00a6100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b580 tx=0x7f0bd4005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:22.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.430+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0be009c6f0 con 0x7f0be4102ac0 2024-04-25T20:45:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.639+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0be4063760 con 0x7f0be4102ac0 2024-04-25T20:45:22.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.640+0000 7f0bdb7fe700 1 -- 172.21.15.43:0/2752195201 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f0be00bc070 con 0x7f0be4102ac0 2024-04-25T20:45:22.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 msgr2=0x7f0bd00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 0x7f0bd00a6100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b580 tx=0x7f0bd4005a90 comp rx=0 tx=0).stop 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 msgr2=0x7f0be40767e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0be000d980 tx=0x7f0be000dc90 comp rx=0 tx=0).stop 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 shutdown_connections 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0bd00a3c40 0x7f0bd00a6100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0be4102ac0 0x7f0be40767e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0be4104660 0x7f0be4075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 --2- 172.21.15.43:0/2752195201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be4103cc0 0x7f0be4074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 >> 172.21.15.43:0/2752195201 conn(0x7f0be40fe060 msgr2=0x7f0be4107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 shutdown_connections 2024-04-25T20:45:22.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:22.642+0000 7f0bec70d700 1 -- 172.21.15.43:0/2752195201 wait complete. 2024-04-25T20:45:22.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: purged_snaps scrub starts 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: purged_snaps scrub ok 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] boot 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:22 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: purged_snaps scrub starts 2024-04-25T20:45:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: purged_snaps scrub ok 2024-04-25T20:45:22.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:22.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] boot 2024-04-25T20:45:22.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T20:45:22.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:22 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:22.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: purged_snaps scrub starts 2024-04-25T20:45:22.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: purged_snaps scrub ok 2024-04-25T20:45:22.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:22.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: osd.11 [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] boot 2024-04-25T20:45:22.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T20:45:22.942 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:22 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:45:23.417 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1714077922,"num_in_osds":12,"osd_in_since":1714077901,"num_remapped_pgs":0} 2024-04-25T20:45:23.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:45:23.667 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2752195201' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: Detected new or changed devices on smithi195 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 4272M 2024-04-25T20:45:23.791 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.791 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:23.791 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:23.791 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2752195201' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: Detected new or changed devices on smithi195 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 4272M 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2752195201' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: Detected new or changed devices on smithi195 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 4272M 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:23.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:25.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 -- 172.21.15.43:0/2951901525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80101960 msgr2=0x7f5e80101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:25.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/2951901525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80101960 0x7f5e80101de0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009990 tx=0x7f5e6c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 -- 172.21.15.43:0/2951901525 shutdown_connections 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/2951901525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80107960 0x7f5e80107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/2951901525 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 0x7f5e8010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/2951901525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80101960 0x7f5e80101de0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 -- 172.21.15.43:0/2951901525 >> 172.21.15.43:0/2951901525 conn(0x7f5e800789e0 msgr2=0x7f5e80078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.380+0000 7f5e86ef2700 1 -- 172.21.15.43:0/2951901525 shutdown_connections 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 -- 172.21.15.43:0/2951901525 wait complete. 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 Processor -- start 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 -- start start 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80101960 0x7f5e80199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 0x7f5e80199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80111d10 con 0x7f5e80107960 2024-04-25T20:45:25.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80111b90 con 0x7f5e80102320 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e86ef2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80111e90 con 0x7f5e80101960 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e8548f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.381+0000 7f5e8548f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33834/0 (socket says 172.21.15.43:33834) 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 -- 172.21.15.43:0/3989270242 learned_addr learned my addr 172.21.15.43:0/3989270242 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e7ffff700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 0x7f5e80199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e84c8e700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80101960 0x7f5e80199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 -- 172.21.15.43:0/3989270242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80101960 msgr2=0x7f5e80199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80101960 0x7f5e80199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 -- 172.21.15.43:0/3989270242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 msgr2=0x7f5e80199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 0x7f5e80199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 -- 172.21.15.43:0/3989270242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8019e360 con 0x7f5e80107960 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e8548f700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e78007d70 tx=0x7f5e7800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78016020 con 0x7f5e80107960 2024-04-25T20:45:25.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8019e650 con 0x7f5e80107960 2024-04-25T20:45:25.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5e7800ac90 con 0x7f5e80107960 2024-04-25T20:45:25.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.382+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780115e0 con 0x7f5e80107960 2024-04-25T20:45:25.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.383+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801a5ed0 con 0x7f5e80107960 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.384+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e80069730 con 0x7f5e80107960 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.384+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5e78019020 con 0x7f5e80107960 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.385+0000 7f5e7dffb700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 0x7f5e700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.385+0000 7f5e84c8e700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 0x7f5e700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.385+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f5e780cfed0 con 0x7f5e80107960 2024-04-25T20:45:25.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.386+0000 7f5e84c8e700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 0x7f5e700a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009a10 tx=0x7f5e74009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:25.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.390+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5e78020020 con 0x7f5e80107960 2024-04-25T20:45:25.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.600+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e8019a6b0 con 0x7f5e80107960 2024-04-25T20:45:25.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.600+0000 7f5e7dffb700 1 -- 172.21.15.43:0/3989270242 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18433 (secure 0 0 0) 0x7f5e7809cd50 con 0x7f5e80107960 2024-04-25T20:45:25.601 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:25.602 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:45:23.003838+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:45:25.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 msgr2=0x7f5e700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:25.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 0x7f5e700a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009a10 tx=0x7f5e74009190 comp rx=0 tx=0).stop 2024-04-25T20:45:25.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 msgr2=0x7f5e8019dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e78007d70 tx=0x7f5e7800a340 comp rx=0 tx=0).stop 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 shutdown_connections 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5e700a3c40 0x7f5e700a6100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e80101960 0x7f5e80199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e80107960 0x7f5e8019dc20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 --2- 172.21.15.43:0/3989270242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e80102320 0x7f5e80199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 >> 172.21.15.43:0/3989270242 conn(0x7f5e800789e0 msgr2=0x7f5e8006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 shutdown_connections 2024-04-25T20:45:25.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:25.603+0000 7f5e86ef2700 1 -- 172.21.15.43:0/3989270242 wait complete. 2024-04-25T20:45:25.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:25 smithi043 ceph-mon[29167]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:25.963 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3989270242' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:45:26.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:25 smithi195 ceph-mon[33250]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:26.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3989270242' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:45:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:25 smithi112 ceph-mon[32322]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3989270242' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:45:26.360 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T20:41:30.665993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T20:45:26.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T20:45:26.606 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:27 smithi043 ceph-mon[29167]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:28.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:27 smithi195 ceph-mon[33250]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:28.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:27 smithi112 ceph-mon[32322]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:28.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 -- 172.21.15.43:0/2215937010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c101950 msgr2=0x7faa9c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2215937010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c101950 0x7faa9c10f920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa940099c0 tx=0x7faa94009cd0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 -- 172.21.15.43:0/2215937010 shutdown_connections 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2215937010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c107a60 0x7faa9c107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2215937010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c101950 0x7faa9c10f920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2215937010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c100f90 0x7faa9c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 -- 172.21.15.43:0/2215937010 >> 172.21.15.43:0/2215937010 conn(0x7faa9c077f40 msgr2=0x7faa9c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 -- 172.21.15.43:0/2215937010 shutdown_connections 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.324+0000 7faaa20f9700 1 -- 172.21.15.43:0/2215937010 wait complete. 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 Processor -- start 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 -- start start 2024-04-25T20:45:28.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c101950 0x7faa9c1026b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c107a60 0x7faa9c102bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c112e50 con 0x7faa9c100f90 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c112cd0 con 0x7faa9c107a60 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faaa20f9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c112fd0 con 0x7faa9c101950 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faa9b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faa9b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40402/0 (socket says 172.21.15.43:40402) 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faa9b7fe700 1 -- 172.21.15.43:0/2299673095 learned_addr learned my addr 172.21.15.43:0/2299673095 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faa9affd700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c101950 0x7faa9c1026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.325+0000 7faa9bfff700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c107a60 0x7faa9c102bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 -- 172.21.15.43:0/2299673095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c101950 msgr2=0x7faa9c1026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c101950 0x7faa9c1026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 -- 172.21.15.43:0/2299673095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c107a60 msgr2=0x7faa9c102bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c107a60 0x7faa9c102bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 -- 172.21.15.43:0/2299673095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c1a7760 con 0x7faa9c100f90 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa9b7fe700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00ada0 tx=0x7faa8c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c017020 con 0x7faa9c100f90 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa8c00cda0 con 0x7faa9c100f90 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c1a7a50 con 0x7faa9c100f90 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c1a7f40 con 0x7faa9c100f90 2024-04-25T20:45:28.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.326+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0053e0 con 0x7faa9c100f90 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.327+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c10afe0 con 0x7faa9c100f90 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.328+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7faa8c004ad0 con 0x7faa9c100f90 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.329+0000 7faa98ff9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 0x7faa880a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.329+0000 7faa9affd700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 0x7faa880a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.329+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7faa8c0cf640 con 0x7faa9c100f90 2024-04-25T20:45:28.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.329+0000 7faa9affd700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 0x7faa880a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa9c100490 tx=0x7faa84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:28.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.334+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faa8c021020 con 0x7faa9c100f90 2024-04-25T20:45:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.540+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa9c104290 con 0x7faa9c100f90 2024-04-25T20:45:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.540+0000 7faa98ff9700 1 -- 172.21.15.43:0/2299673095 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7faa8c09c550 con 0x7faa9c100f90 2024-04-25T20:45:28.541 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 msgr2=0x7faa880a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 0x7faa880a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa9c100490 tx=0x7faa84009260 comp rx=0 tx=0).stop 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 msgr2=0x7faa9c102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00ada0 tx=0x7faa8c00c330 comp rx=0 tx=0).stop 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 shutdown_connections 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.542+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa880a3c40 0x7faa880a6100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c107a60 0x7faa9c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa9c100f90 0x7faa9c102170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 --2- 172.21.15.43:0/2299673095 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faa9c101950 0x7faa9c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 >> 172.21.15.43:0/2299673095 conn(0x7faa9c077f40 msgr2=0x7faa9c105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 shutdown_connections 2024-04-25T20:45:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:28.543+0000 7faaa20f9700 1 -- 172.21.15.43:0/2299673095 wait complete. 2024-04-25T20:45:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:28 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2299673095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T20:45:29.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:28 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2299673095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T20:45:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:28 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2299673095' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T20:45:29.402 INFO:tasks.cephadm:Adding mds.a on smithi043 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.d on smithi043 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.g on smithi043 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.j on smithi043 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.b on smithi112 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.e on smithi112 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.h on smithi112 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.k on smithi112 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.c on smithi195 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.f on smithi195 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.i on smithi195 2024-04-25T20:45:29.403 INFO:tasks.cephadm:Adding mds.l on smithi195 2024-04-25T20:45:29.404 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l' 2024-04-25T20:45:29.653 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T20:45:30.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:29 smithi195 ceph-mon[33250]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:29 smithi043 ceph-mon[29167]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:29 smithi112 ceph-mon[32322]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:31.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 -- 172.21.15.195:0/449567399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc103530 msgr2=0x7f0bbc105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/449567399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc103530 0x7f0bbc105920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009990 tx=0x7f0bb0009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 -- 172.21.15.195:0/449567399 shutdown_connections 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/449567399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc103530 0x7f0bbc105920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/449567399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc10ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/449567399 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc105e60 0x7f0bbc108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 -- 172.21.15.195:0/449567399 >> 172.21.15.195:0/449567399 conn(0x7f0bbc0fcf40 msgr2=0x7f0bbc0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 -- 172.21.15.195:0/449567399 shutdown_connections 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.355+0000 7f0bc29ac700 1 -- 172.21.15.195:0/449567399 wait complete. 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 Processor -- start 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 -- start start 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc103530 0x7f0bbc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:31.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10e6e0 con 0x7f0bbc108790 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10e560 con 0x7f0bbc103530 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc29ac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10e860 con 0x7f0bbc105e60 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44736/0 (socket says 172.21.15.195:44736) 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bbb7fe700 1 -- 172.21.15.195:0/3466409558 learned_addr learned my addr 172.21.15.195:0/3466409558 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bbbfff700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc103530 0x7f0bbc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.356+0000 7f0bc0f49700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 -- 172.21.15.195:0/3466409558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc103530 msgr2=0x7f0bbc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc103530 0x7f0bbc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 -- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 msgr2=0x7f0bbc1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:31.360 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc1a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 -- 172.21.15.195:0/3466409558 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc1a09c0 con 0x7f0bbc105e60 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bc0f49700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bbb7fe700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b560 tx=0x7f0bac00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac015020 con 0x7f0bbc105e60 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0bac011d00 con 0x7f0bbc105e60 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac010e60 con 0x7f0bbc105e60 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bbc1a0cb0 con 0x7f0bbc105e60 2024-04-25T20:45:31.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.357+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bbc1a11a0 con 0x7f0bbc105e60 2024-04-25T20:45:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.358+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bbc069730 con 0x7f0bbc105e60 2024-04-25T20:45:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.360+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0bac018020 con 0x7f0bbc105e60 2024-04-25T20:45:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.360+0000 7f0bb97fa700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 0x7f0ba40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.361+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f0bac0cfc00 con 0x7f0bbc105e60 2024-04-25T20:45:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.361+0000 7f0bbbfff700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 0x7f0ba40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:31.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.361+0000 7f0bbbfff700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 0x7f0ba40a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000b5c0 tx=0x7f0bb0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:31.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.364+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0bac01f020 con 0x7f0bbc105e60 2024-04-25T20:45:31.573 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.572+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}) -- 0x7f0bbc063080 con 0x7f0ba40a3c40 2024-04-25T20:45:31.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.580+0000 7f0bb97fa700 1 -- 172.21.15.195:0/3466409558 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0bbc063080 con 0x7f0ba40a3c40 2024-04-25T20:45:31.582 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mds.all update... 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 msgr2=0x7f0ba40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 0x7f0ba40a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000b5c0 tx=0x7f0bb0005fb0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 msgr2=0x7f0bbc1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00b560 tx=0x7f0bac00b870 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 shutdown_connections 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0ba40a3c40 0x7f0ba40a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bbc108790 0x7f0bbc1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bbc103530 0x7f0bbc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 --2- 172.21.15.195:0/3466409558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc105e60 0x7f0bbc1992a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.582+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 >> 172.21.15.195:0/3466409558 conn(0x7f0bbc0fcf40 msgr2=0x7f0bbc103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.583+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 shutdown_connections 2024-04-25T20:45:31.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-25T20:45:31.583+0000 7f0bc29ac700 1 -- 172.21.15.195:0/3466409558 wait complete. 2024-04-25T20:45:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:31 smithi043 ceph-mon[29167]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:32.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:31 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:31 smithi195 ceph-mon[33250]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:32.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:32.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:31 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:31 smithi112 ceph-mon[32322]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:31 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:45:32.276 DEBUG:teuthology.orchestra.run.smithi043:mds.a> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.a.service 2024-04-25T20:45:32.279 DEBUG:teuthology.orchestra.run.smithi043:mds.d> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.d.service 2024-04-25T20:45:32.322 DEBUG:teuthology.orchestra.run.smithi043:mds.g> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.g.service 2024-04-25T20:45:32.366 DEBUG:teuthology.orchestra.run.smithi043:mds.j> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.j.service 2024-04-25T20:45:32.408 DEBUG:teuthology.orchestra.run.smithi112:mds.b> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.b.service 2024-04-25T20:45:32.411 DEBUG:teuthology.orchestra.run.smithi112:mds.e> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.e.service 2024-04-25T20:45:32.453 DEBUG:teuthology.orchestra.run.smithi112:mds.h> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.h.service 2024-04-25T20:45:32.496 DEBUG:teuthology.orchestra.run.smithi112:mds.k> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.k.service 2024-04-25T20:45:32.539 DEBUG:teuthology.orchestra.run.smithi195:mds.c> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.c.service 2024-04-25T20:45:32.542 DEBUG:teuthology.orchestra.run.smithi195:mds.f> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.f.service 2024-04-25T20:45:32.585 DEBUG:teuthology.orchestra.run.smithi195:mds.i> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.i.service 2024-04-25T20:45:32.628 DEBUG:teuthology.orchestra.run.smithi195:mds.l> sudo journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.l.service 2024-04-25T20:45:32.672 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-25T20:45:32.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:45:32.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:32.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:32 smithi195 ceph-mon[33250]: Deploying daemon mds.l on smithi195 2024-04-25T20:45:32.916 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:33.039 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:45:33.039 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-04-25T20:45:33.039 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:33.039 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:33.039 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:33.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:33.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:33.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:33.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:32 smithi043 ceph-mon[29167]: Deploying daemon mds.l on smithi195 2024-04-25T20:45:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:45:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: Saving service mds.all spec with placement smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-04-25T20:45:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:45:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:32 smithi112 ceph-mon[32322]: Deploying daemon mds.l on smithi195 2024-04-25T20:45:34.533 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:34 smithi195 ceph-mon[33250]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:34.639 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:34 smithi043 ceph-mon[29167]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 -- 172.21.15.43:0/4053828821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8102ac0 msgr2=0x7f89c8102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/4053828821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8102ac0 0x7f89c8102f40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009990 tx=0x7f89bc009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 -- 172.21.15.43:0/4053828821 shutdown_connections 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/4053828821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c810f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/4053828821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8108a70 0x7f89c8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/4053828821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8102ac0 0x7f89c8102f40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 -- 172.21.15.43:0/4053828821 >> 172.21.15.43:0/4053828821 conn(0x7f89c8079bb0 msgr2=0x7f89c8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 -- 172.21.15.43:0/4053828821 shutdown_connections 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.638+0000 7f89ccb9f700 1 -- 172.21.15.43:0/4053828821 wait complete. 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 Processor -- start 2024-04-25T20:45:34.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 -- start start 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8102ac0 0x7f89c8074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8112dc0 con 0x7f89c8108a70 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8112c40 con 0x7f89c8102ac0 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89ccb9f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8112f40 con 0x7f89c8103480 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89c6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89c6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40426/0 (socket says 172.21.15.43:40426) 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:50018/0 (socket says 172.21.15.43:50018) 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.639+0000 7f89c6d9d700 1 -- 172.21.15.43:0/2846557278 learned_addr learned my addr 172.21.15.43:0/2846557278 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c659c700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8102ac0 0x7f89c8074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:34.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 -- 172.21.15.43:0/2846557278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 msgr2=0x7f89c8075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 -- 172.21.15.43:0/2846557278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8102ac0 msgr2=0x7f89c8074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8102ac0 0x7f89c8074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 -- 172.21.15.43:0/2846557278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c81a7770 con 0x7f89c8108a70 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c5d9b700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89c6d9d700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007ee0 tx=0x7f89c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c000dd20 con 0x7f89c8108a70 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c81a7a60 con 0x7f89c8108a70 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f89c0004020 con 0x7f89c8108a70 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0015640 con 0x7f89c8108a70 2024-04-25T20:45:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.640+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c81a7fc0 con 0x7f89c8108a70 2024-04-25T20:45:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.642+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c8069730 con 0x7f89c8108a70 2024-04-25T20:45:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.643+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f89c0003a00 con 0x7f89c8108a70 2024-04-25T20:45:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.643+0000 7f89b77fe700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 0x7f89b00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.644+0000 7f89c659c700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 0x7f89b00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.644+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f89c00cf910 con 0x7f89c8108a70 2024-04-25T20:45:34.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.644+0000 7f89c659c700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 0x7f89b00a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009a10 tx=0x7f89b8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:34.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.648+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f89c0010070 con 0x7f89c8108a70 2024-04-25T20:45:34.841 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:34 smithi195 systemd[1]: Starting Ceph mds.l for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:45:34.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:34 smithi112 ceph-mon[32322]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:34.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.905+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c802df80 con 0x7f89c8108a70 2024-04-25T20:45:34.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.906+0000 7f89b77fe700 1 -- 172.21.15.43:0/2846557278 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f89c0003cf0 con 0x7f89c8108a70 2024-04-25T20:45:34.906 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:34.906 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T20:45:34.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 msgr2=0x7f89b00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 0x7f89b00a6100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009a10 tx=0x7f89b8009190 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 msgr2=0x7f89c80757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007ee0 tx=0x7f89c000d3b0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 shutdown_connections 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f89b00a3c40 0x7f89b00a6100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c8108a70 0x7f89c80757c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f89c8102ac0 0x7f89c8074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 --2- 172.21.15.43:0/2846557278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89c8103480 0x7f89c8075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 >> 172.21.15.43:0/2846557278 conn(0x7f89c8079bb0 msgr2=0x7f89c8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 shutdown_connections 2024-04-25T20:45:34.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:34.908+0000 7f89ccb9f700 1 -- 172.21.15.43:0/2846557278 wait complete. 2024-04-25T20:45:34.910 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 1 2024-04-25T20:45:35.239 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:34 smithi195 podman[63379]: 2024-04-25 20:45:34.831127108 +0000 UTC m=+0.017773858 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:45:35.239 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:34 smithi195 podman[63379]: 2024-04-25 20:45:34.944388495 +0000 UTC m=+0.131035236 container create cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T20:45:35.239 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 podman[63379]: 2024-04-25 20:45:35.238688335 +0000 UTC m=+0.425335076 container init cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T20:45:35.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2846557278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:35.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6832/2602577561,v1:172.21.15.195:6833/2602577561] up:boot 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: fsmap 1 up:standby 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:35.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:35 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:35.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2846557278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6832/2602577561,v1:172.21.15.195:6833/2602577561] up:boot 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: fsmap 1 up:standby 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 podman[63379]: 2024-04-25 20:45:35.241491942 +0000 UTC m=+0.428138692 container start cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-25T20:45:35.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-mds[63398]: -- 172.21.15.195:0/3792391201 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627e65cfa40 con 0x5627e65a2c00 2024-04-25T20:45:35.593 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: starting mds.l at 2024-04-25T20:45:35.593 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 bash[63379]: cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 2024-04-25T20:45:35.593 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 20:45:35 smithi195 systemd[1]: Started Ceph mds.l for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:35.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2846557278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6832/2602577561,v1:172.21.15.195:6833/2602577561] up:boot 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: fsmap 1 up:standby 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:35.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:35 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:36.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:36 smithi112 ceph-mon[32322]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:36.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:36 smithi112 ceph-mon[32322]: Deploying daemon mds.k on smithi112 2024-04-25T20:45:36.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:36 smithi043 ceph-mon[29167]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:36.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:36 smithi043 ceph-mon[29167]: Deploying daemon mds.k on smithi112 2024-04-25T20:45:36.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:36 smithi195 ceph-mon[33250]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:36.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:36 smithi195 ceph-mon[33250]: Deploying daemon mds.k on smithi112 2024-04-25T20:45:37.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:45:37.843 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:37 smithi112 systemd[1]: Starting Ceph mds.k for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:45:37.944 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:38.117 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:37 smithi112 podman[61656]: 2024-04-25 20:45:37.769285118 +0000 UTC m=+0.018423826 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:45:38.118 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:37 smithi112 podman[61656]: 2024-04-25 20:45:37.889913343 +0000 UTC m=+0.139052044 container create d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T20:45:38.118 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 podman[61656]: 2024-04-25 20:45:38.117671638 +0000 UTC m=+0.366810341 container init d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T20:45:38.474 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 podman[61656]: 2024-04-25 20:45:38.120448777 +0000 UTC m=+0.369587480 container start d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-25T20:45:38.474 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mds[61675]: -- 172.21.15.112:0/2170554097 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c4476fa40 con 0x555c44742800 2024-04-25T20:45:38.474 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: starting mds.k at 2024-04-25T20:45:38.474 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 bash[61656]: d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a 2024-04-25T20:45:38.474 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 20:45:38 smithi112 systemd[1]: Started Ceph mds.k for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:38.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:38.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:38.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:38.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:38 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:38.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:38.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:38 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:38.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:38.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:38.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:38 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:39.530 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:39 smithi112 ceph-mon[32322]: Deploying daemon mds.j on smithi043 2024-04-25T20:45:39.530 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:39 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6832/2634876322,v1:172.21.15.112:6833/2634876322] up:boot 2024-04-25T20:45:39.530 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:39 smithi112 ceph-mon[32322]: fsmap 2 up:standby 2024-04-25T20:45:39.531 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:39 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:45:39.642 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:39 smithi043 ceph-mon[29167]: Deploying daemon mds.j on smithi043 2024-04-25T20:45:39.642 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:39 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6832/2634876322,v1:172.21.15.112:6833/2634876322] up:boot 2024-04-25T20:45:39.642 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:39 smithi043 ceph-mon[29167]: fsmap 2 up:standby 2024-04-25T20:45:39.642 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:39 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 -- 172.21.15.43:0/196539002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8107960 msgr2=0x7f75c8107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/196539002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8107960 0x7f75c8107d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009990 tx=0x7f75b8009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 -- 172.21.15.43:0/196539002 shutdown_connections 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/196539002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8102320 0x7f75c810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/196539002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8107960 0x7f75c8107d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/196539002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8101960 0x7f75c8101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 -- 172.21.15.43:0/196539002 >> 172.21.15.43:0/196539002 conn(0x7f75c80789e0 msgr2=0x7f75c8078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 -- 172.21.15.43:0/196539002 shutdown_connections 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.744+0000 7f75ce8ba700 1 -- 172.21.15.43:0/196539002 wait complete. 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 Processor -- start 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 -- start start 2024-04-25T20:45:39.748 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8102320 0x7f75c819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8107960 0x7f75c819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8111d30 con 0x7f75c8101960 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8111bb0 con 0x7f75c8107960 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75ce8ba700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8111eb0 con 0x7f75c8102320 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75c7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75c7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49384/0 (socket says 172.21.15.43:49384) 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.745+0000 7f75c7fff700 1 -- 172.21.15.43:0/230277016 learned_addr learned my addr 172.21.15.43:0/230277016 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75cce57700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8107960 0x7f75c819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c77fe700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8102320 0x7f75c819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 -- 172.21.15.43:0/230277016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8102320 msgr2=0x7f75c819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8102320 0x7f75c819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 -- 172.21.15.43:0/230277016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8107960 msgr2=0x7f75c819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8107960 0x7f75c819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 -- 172.21.15.43:0/230277016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c81a0590 con 0x7f75c8101960 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c7fff700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005910 tx=0x7f75b8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8027070 con 0x7f75c8101960 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75b8004680 con 0x7f75c8101960 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8022cb0 con 0x7f75c8101960 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c81a0820 con 0x7f75c8101960 2024-04-25T20:45:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.746+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c81a8100 con 0x7f75c8101960 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.747+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c8069730 con 0x7f75c8101960 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.748+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f75b802a070 con 0x7f75c8101960 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.749+0000 7f75c57fa700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 0x7f75b00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.749+0000 7f75c77fe700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 0x7f75b00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.749+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f75b80d1500 con 0x7f75c8101960 2024-04-25T20:45:39.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.750+0000 7f75c77fe700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 0x7f75b00a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75c8078e00 tx=0x7f75bc00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:39.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:39.753+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f75b8031070 con 0x7f75c8101960 2024-04-25T20:45:39.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:39 smithi195 ceph-mon[33250]: Deploying daemon mds.j on smithi043 2024-04-25T20:45:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:39 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6832/2634876322,v1:172.21.15.112:6833/2634876322] up:boot 2024-04-25T20:45:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:39 smithi195 ceph-mon[33250]: fsmap 2 up:standby 2024-04-25T20:45:39.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:39 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:45:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.014+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75c81a82d0 con 0x7f75c8101960 2024-04-25T20:45:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.014+0000 7f75c57fa700 1 -- 172.21.15.43:0/230277016 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f75b80a4070 con 0x7f75c8101960 2024-04-25T20:45:40.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:40.016 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 msgr2=0x7f75b00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 0x7f75b00a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75c8078e00 tx=0x7f75bc00b3c0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 msgr2=0x7f75c819b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005910 tx=0x7f75b8005ef0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 shutdown_connections 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f75b00a3c40 0x7f75b00a6100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75c8107960 0x7f75c819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c8101960 0x7f75c819b5d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 --2- 172.21.15.43:0/230277016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c8102320 0x7f75c819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 >> 172.21.15.43:0/230277016 conn(0x7f75c80789e0 msgr2=0x7f75c810cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 shutdown_connections 2024-04-25T20:45:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:40.016+0000 7f75ce8ba700 1 -- 172.21.15.43:0/230277016 wait complete. 2024-04-25T20:45:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2024-04-25T20:45:40.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:40 smithi043 ceph-mon[29167]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:40.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:40 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/230277016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:40.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:40 smithi195 ceph-mon[33250]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:40.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:40 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/230277016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:40 smithi112 ceph-mon[32322]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:40.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:40 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/230277016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:42.295 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 systemd[1]: Starting Ceph mds.j for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:45:42.721 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:42 smithi043 ceph-mon[29167]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:42.721 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 podman[70243]: 2024-04-25 20:45:42.351636912 +0000 UTC m=+0.018383589 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:45:42.721 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 podman[70243]: 2024-04-25 20:45:42.475043645 +0000 UTC m=+0.141790306 container create 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T20:45:42.722 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 podman[70243]: 2024-04-25 20:45:42.694641281 +0000 UTC m=+0.361387943 container init 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:45:42.722 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 podman[70243]: 2024-04-25 20:45:42.697394577 +0000 UTC m=+0.364141242 container start 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-25T20:45:42.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:42 smithi195 ceph-mon[33250]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:42.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:42 smithi112 ceph-mon[32322]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:43.044 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 ceph-mds[70263]: -- 172.21.15.43:0/2011975385 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55798aea9a40 con 0x55798ae7cc00 2024-04-25T20:45:43.044 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j[70259]: starting mds.j at 2024-04-25T20:45:43.045 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 bash[70243]: 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd 2024-04-25T20:45:43.045 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 20:45:42 smithi043 systemd[1]: Started Ceph mds.j for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:43.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: Deploying daemon mds.d on smithi043 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6834/3741268210,v1:172.21.15.43:6835/3741268210] up:boot 2024-04-25T20:45:44.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: fsmap 3 up:standby 2024-04-25T20:45:44.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:43 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: Deploying daemon mds.d on smithi043 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6834/3741268210,v1:172.21.15.43:6835/3741268210] up:boot 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: fsmap 3 up:standby 2024-04-25T20:45:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:43 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: Deploying daemon mds.d on smithi043 2024-04-25T20:45:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6834/3741268210,v1:172.21.15.43:6835/3741268210] up:boot 2024-04-25T20:45:44.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: fsmap 3 up:standby 2024-04-25T20:45:44.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:43 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:45:44.704 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:45.545 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:45 smithi043 systemd[1]: Starting Ceph mds.d for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:45:45.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:45 smithi043 ceph-mon[29167]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:46.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:45 smithi112 ceph-mon[32322]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:46.254 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 podman[70644]: 2024-04-25 20:45:46.005855255 +0000 UTC m=+0.020361246 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:45:46.254 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 podman[70644]: 2024-04-25 20:45:46.131346615 +0000 UTC m=+0.145852655 container create af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T20:45:46.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:45 smithi195 ceph-mon[33250]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:46.795 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 podman[70644]: 2024-04-25 20:45:46.612051095 +0000 UTC m=+0.626557067 container init af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T20:45:46.795 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 podman[70644]: 2024-04-25 20:45:46.615112019 +0000 UTC m=+0.629617992 container start af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T20:45:46.795 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 ceph-mds[70686]: -- 172.21.15.43:0/3247788949 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564353451a40 con 0x564353425000 2024-04-25T20:45:46.795 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d[70675]: starting mds.d at 2024-04-25T20:45:46.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 -- 172.21.15.43:0/673805872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff406bbb0 msgr2=0x7f1ff410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:46.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/673805872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff406bbb0 0x7f1ff410f930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00b0a0 tx=0x7f1fec00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 -- 172.21.15.43:0/673805872 shutdown_connections 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/673805872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff4108a60 0x7f1ff4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/673805872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff406bbb0 0x7f1ff410f930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/673805872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406b1f0 0x7f1ff406b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 -- 172.21.15.43:0/673805872 >> 172.21.15.43:0/673805872 conn(0x7f1ff40789e0 msgr2=0x7f1ff4078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 -- 172.21.15.43:0/673805872 shutdown_connections 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.816+0000 7f1ffa72c700 1 -- 172.21.15.43:0/673805872 wait complete. 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 Processor -- start 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 -- start start 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff406b1f0 0x7f1ff41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 0x7f1ff4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:46.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4112dc0 con 0x7f1ff4108a60 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4112c40 con 0x7f1ff406bbb0 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ffa72c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4112f40 con 0x7f1ff406b1f0 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ff8cc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ff8cc9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37394/0 (socket says 172.21.15.43:37394) 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ff8cc9700 1 -- 172.21.15.43:0/925545712 learned_addr learned my addr 172.21.15.43:0/925545712 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ff37fe700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 0x7f1ff4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.817+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff406b1f0 0x7f1ff41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 -- 172.21.15.43:0/925545712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff406b1f0 msgr2=0x7f1ff41991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff406b1f0 0x7f1ff41991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 -- 172.21.15.43:0/925545712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 msgr2=0x7f1ff4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 0x7f1ff4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 -- 172.21.15.43:0/925545712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff419e1e0 con 0x7f1ff4108a60 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff37fe700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 0x7f1ff4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:45:46.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff8cc9700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1fec006070 tx=0x7f1fec004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec021070 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fec007e50 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff419e470 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec004830 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.818+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff41a5d50 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.819+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff41041a0 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.820+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1fec004020 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.821+0000 7f1ff17fa700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 0x7f1fe00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.821+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 0x7f1fe00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.821+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f1fec0d0f60 con 0x7f1ff4108a60 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.821+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 0x7f1fe00a6100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400bbb0 tx=0x7f1fe400b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:46.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:46.825+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1fec09de70 con 0x7f1ff4108a60 2024-04-25T20:45:47.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.093+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ff419a530 con 0x7f1ff4108a60 2024-04-25T20:45:47.096 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 bash[70644]: af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 2024-04-25T20:45:47.096 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 20:45:46 smithi043 systemd[1]: Started Ceph mds.d for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:47.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.094+0000 7f1ff17fa700 1 -- 172.21.15.43:0/925545712 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f1fec09d770 con 0x7f1ff4108a60 2024-04-25T20:45:47.096 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:47.096 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T20:45:47.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.096+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 msgr2=0x7f1fe00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:47.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.096+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 0x7f1fe00a6100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400bbb0 tx=0x7f1fe400b590 comp rx=0 tx=0).stop 2024-04-25T20:45:47.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 msgr2=0x7f1ff419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:47.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1fec006070 tx=0x7f1fec004db0 comp rx=0 tx=0).stop 2024-04-25T20:45:47.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 shutdown_connections 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f1fe00a3c40 0x7f1fe00a6100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ff406b1f0 0x7f1ff41991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff4108a60 0x7f1ff419daa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 --2- 172.21.15.43:0/925545712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ff406bbb0 0x7f1ff4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 >> 172.21.15.43:0/925545712 conn(0x7f1ff40789e0 msgr2=0x7f1ff40ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 shutdown_connections 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:47.097+0000 7f1ffa72c700 1 -- 172.21.15.43:0/925545712 wait complete. 2024-04-25T20:45:47.099 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 5 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6836/4072774695,v1:172.21.15.43:6837/4072774695] up:boot 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: fsmap 4 up:standby 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:47.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:47.940 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:47.940 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:47.940 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:47.940 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: Deploying daemon mds.e on smithi112 2024-04-25T20:45:47.940 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:47 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/925545712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6836/4072774695,v1:172.21.15.43:6837/4072774695] up:boot 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: fsmap 4 up:standby 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: Deploying daemon mds.e on smithi112 2024-04-25T20:45:48.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:47 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/925545712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6836/4072774695,v1:172.21.15.43:6837/4072774695] up:boot 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: fsmap 4 up:standby 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:48.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:48.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: Deploying daemon mds.e on smithi112 2024-04-25T20:45:48.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:47 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/925545712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:49.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:45:50.055 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:49 smithi112 ceph-mon[32322]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:50.092 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 20:45:49 smithi112 systemd[1]: Started Ceph mds.e for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:50.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:49 smithi043 ceph-mon[29167]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:49 smithi195 ceph-mon[33250]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:51.185 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:51.186 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: Deploying daemon mds.f on smithi195 2024-04-25T20:45:51.186 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6834/1792854312,v1:172.21.15.112:6835/1792854312] up:boot 2024-04-25T20:45:51.186 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: fsmap 5 up:standby 2024-04-25T20:45:51.186 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:50 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: Deploying daemon mds.f on smithi195 2024-04-25T20:45:51.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6834/1792854312,v1:172.21.15.112:6835/1792854312] up:boot 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: fsmap 5 up:standby 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:50 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:51.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: Deploying daemon mds.f on smithi195 2024-04-25T20:45:51.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6834/1792854312,v1:172.21.15.112:6835/1792854312] up:boot 2024-04-25T20:45:51.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: fsmap 5 up:standby 2024-04-25T20:45:51.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:50 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:45:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 -- 172.21.15.43:0/2312234229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600102a90 msgr2=0x7f5600102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 --2- 172.21.15.43:0/2312234229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600102a90 0x7f5600102f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009990 tx=0x7f55f4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 -- 172.21.15.43:0/2312234229 shutdown_connections 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 --2- 172.21.15.43:0/2312234229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600108a50 0x7f5600108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 --2- 172.21.15.43:0/2312234229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 0x7f560010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 --2- 172.21.15.43:0/2312234229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600102a90 0x7f5600102f10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 -- 172.21.15.43:0/2312234229 >> 172.21.15.43:0/2312234229 conn(0x7f5600079ba0 msgr2=0x7f5600079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 -- 172.21.15.43:0/2312234229 shutdown_connections 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 -- 172.21.15.43:0/2312234229 wait complete. 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.903+0000 7f56051d1700 1 Processor -- start 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 -- start start 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600102a90 0x7f56001991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 0x7f5600199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5600112d40 con 0x7f5600108a50 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5600112bc0 con 0x7f5600103450 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f56051d1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5600112ec0 con 0x7f5600102a90 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55fed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600102a90 0x7f56001991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37416/0 (socket says 172.21.15.43:37416) 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 -- 172.21.15.43:0/177636840 learned_addr learned my addr 172.21.15.43:0/177636840 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55fe59c700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 0x7f5600199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 -- 172.21.15.43:0/177636840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600102a90 msgr2=0x7f56001991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600102a90 0x7f56001991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 -- 172.21.15.43:0/177636840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 msgr2=0x7f5600199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 0x7f5600199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.904+0000 7f55ff59e700 1 -- 172.21.15.43:0/177636840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560019e200 con 0x7f5600108a50 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f55ff59e700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007ee0 tx=0x7f55f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8004bb0 con 0x7f5600108a50 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55f8004d50 con 0x7f5600108a50 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560019e4f0 con 0x7f5600108a50 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80059e0 con 0x7f5600108a50 2024-04-25T20:45:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.905+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56001a5d70 con 0x7f5600108a50 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.906+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5600069730 con 0x7f5600108a50 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.907+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f55f801a020 con 0x7f5600108a50 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.908+0000 7f55e7fff700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 0x7f55e80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.908+0000 7f55fed9d700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 0x7f55e80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.909+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f55f80cfca0 con 0x7f5600108a50 2024-04-25T20:45:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.909+0000 7f55fed9d700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 0x7f55e80a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55f000abd0 tx=0x7f55f000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:51.912+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f55f8010070 con 0x7f5600108a50 2024-04-25T20:45:52.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.168+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f560002df80 con 0x7f5600108a50 2024-04-25T20:45:52.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.169+0000 7f55e7fff700 1 -- 172.21.15.43:0/177636840 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7f55f809cb00 con 0x7f5600108a50 2024-04-25T20:45:52.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:52.171 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T20:45:52.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 msgr2=0x7f55e80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 0x7f55e80a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f55f000abd0 tx=0x7f55f000a380 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 msgr2=0x7f560019dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007ee0 tx=0x7f55f800d3b0 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 shutdown_connections 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f55e80a3c40 0x7f55e80a6100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5600102a90 0x7f56001991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5600108a50 0x7f560019dac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 --2- 172.21.15.43:0/177636840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5600103450 0x7f5600199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 >> 172.21.15.43:0/177636840 conn(0x7f5600079ba0 msgr2=0x7f56001017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 shutdown_connections 2024-04-25T20:45:52.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:52.171+0000 7f56051d1700 1 -- 172.21.15.43:0/177636840 wait complete. 2024-04-25T20:45:52.174 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-25T20:45:52.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:52 smithi195 ceph-mon[33250]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:52.342 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 systemd[1]: Starting Ceph mds.f for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:45:52.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:52 smithi112 ceph-mon[32322]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:52.492 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:52 smithi043 ceph-mon[29167]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:52.694 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 podman[63697]: 2024-04-25 20:45:52.312160336 +0000 UTC m=+0.018218681 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:45:52.694 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 podman[63697]: 2024-04-25 20:45:52.433071463 +0000 UTC m=+0.139129786 container create 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416) 2024-04-25T20:45:52.695 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 podman[63697]: 2024-04-25 20:45:52.694122111 +0000 UTC m=+0.400180437 container init 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-04-25T20:45:53.063 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 podman[63697]: 2024-04-25 20:45:52.696975636 +0000 UTC m=+0.403033953 container start 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:45:53.063 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 ceph-mds[63717]: -- 172.21.15.195:0/3742669151 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f100f97a40 con 0x55f100f6a800 2024-04-25T20:45:53.063 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: starting mds.f at 2024-04-25T20:45:53.063 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 bash[63697]: 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 2024-04-25T20:45:53.064 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 20:45:52 smithi195 systemd[1]: Started Ceph mds.f for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/177636840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:53.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:53 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:53.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/177636840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:53 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/177636840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:53.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:53.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:53.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:53.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:53 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:54 smithi195 ceph-mon[33250]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:54 smithi195 ceph-mon[33250]: Deploying daemon mds.c on smithi195 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:54 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:boot 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:54 smithi195 ceph-mon[33250]: fsmap 6 up:standby 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:54 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:54 smithi112 ceph-mon[32322]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:54 smithi112 ceph-mon[32322]: Deploying daemon mds.c on smithi195 2024-04-25T20:45:54.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:54 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:boot 2024-04-25T20:45:54.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:54 smithi112 ceph-mon[32322]: fsmap 6 up:standby 2024-04-25T20:45:54.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:54 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:45:54.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:54 smithi043 ceph-mon[29167]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:54.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:54 smithi043 ceph-mon[29167]: Deploying daemon mds.c on smithi195 2024-04-25T20:45:54.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:54 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:boot 2024-04-25T20:45:54.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:54 smithi043 ceph-mon[29167]: fsmap 6 up:standby 2024-04-25T20:45:54.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:54 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:45:54.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:45:55.117 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:45:55.841 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 20:45:55 smithi195 systemd[1]: Started Ceph mds.c for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:56 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:56.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:56.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:56 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:56.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:56.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:45:56.458 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:45:56.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:45:56.459 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:56 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:45:56.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 -- 172.21.15.43:0/2229636854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708102ac0 msgr2=0x7f6708102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:56.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 --2- 172.21.15.43:0/2229636854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708102ac0 0x7f6708102f40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009990 tx=0x7f66f8009ca0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 -- 172.21.15.43:0/2229636854 shutdown_connections 2024-04-25T20:45:56.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 --2- 172.21.15.43:0/2229636854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 0x7f670810f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 --2- 172.21.15.43:0/2229636854 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708108a70 0x7f6708108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 --2- 172.21.15.43:0/2229636854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708102ac0 0x7f6708102f40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 -- 172.21.15.43:0/2229636854 >> 172.21.15.43:0/2229636854 conn(0x7f6708079bb0 msgr2=0x7f6708079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 -- 172.21.15.43:0/2229636854 shutdown_connections 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.874+0000 7f6710649700 1 -- 172.21.15.43:0/2229636854 wait complete. 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 Processor -- start 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 -- start start 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708102ac0 0x7f6708199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 0x7f6708199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6708112d80 con 0x7f6708108a70 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6708112c00 con 0x7f6708102ac0 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f6710649700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6708112f00 con 0x7f6708103480 2024-04-25T20:45:56.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f670ebe6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f670ebe6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60768/0 (socket says 172.21.15.43:60768) 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f670ebe6700 1 -- 172.21.15.43:0/2529251040 learned_addr learned my addr 172.21.15.43:0/2529251040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.875+0000 7f670dbe4700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 0x7f6708199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670e3e5700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708102ac0 0x7f6708199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 -- 172.21.15.43:0/2529251040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 msgr2=0x7f6708199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 0x7f6708199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 -- 172.21.15.43:0/2529251040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708102ac0 msgr2=0x7f6708199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708102ac0 0x7f6708199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 -- 172.21.15.43:0/2529251040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670819e1f0 con 0x7f6708108a70 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f670ebe6700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6700007ee0 tx=0x7f670000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700004bb0 con 0x7f6708108a70 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670819e4e0 con 0x7f6708108a70 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6700004d50 con 0x7f6708108a70 2024-04-25T20:45:56.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000059e0 con 0x7f6708108a70 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.876+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67081a5d60 con 0x7f6708108a70 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.877+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6708069730 con 0x7f6708108a70 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.878+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f670001a020 con 0x7f6708108a70 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.879+0000 7f66ff7fe700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 0x7f66f40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.879+0000 7f670e3e5700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 0x7f66f40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.879+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f67000cfc50 con 0x7f6708108a70 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.879+0000 7f670e3e5700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 0x7f66f40a6100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6704005950 tx=0x7f670400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:45:56.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:56.883+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6700010070 con 0x7f6708108a70 2024-04-25T20:45:57.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.143+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f670802df80 con 0x7f6708108a70 2024-04-25T20:45:57.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.143+0000 7f66ff7fe700 1 -- 172.21.15.43:0/2529251040 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6352 (secure 0 0 0) 0x7f670009cad0 con 0x7f6708108a70 2024-04-25T20:45:57.145 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:45:57.145 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-25T20:45:57.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 msgr2=0x7f66f40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:57.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 0x7f66f40a6100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6704005950 tx=0x7f670400b410 comp rx=0 tx=0).stop 2024-04-25T20:45:57.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 msgr2=0x7f670819dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:45:57.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6700007ee0 tx=0x7f670000d3b0 comp rx=0 tx=0).stop 2024-04-25T20:45:57.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 shutdown_connections 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f66f40a3c40 0x7f66f40a6100 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6708108a70 0x7f670819dab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6708102ac0 0x7f6708199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 --2- 172.21.15.43:0/2529251040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6708103480 0x7f6708199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.145+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 >> 172.21.15.43:0/2529251040 conn(0x7f6708079bb0 msgr2=0x7f6708101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.146+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 shutdown_connections 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:45:57.146+0000 7f6710649700 1 -- 172.21.15.43:0/2529251040 wait complete. 2024-04-25T20:45:57.148 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2024-04-25T20:45:57.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:57 smithi195 ceph-mon[33250]: Deploying daemon mds.h on smithi112 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:57 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:boot 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:57 smithi195 ceph-mon[33250]: fsmap 7 up:standby 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:57 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:57 smithi112 ceph-mon[32322]: Deploying daemon mds.h on smithi112 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:57 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:boot 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:57 smithi112 ceph-mon[32322]: fsmap 7 up:standby 2024-04-25T20:45:57.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:57 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:45:57.468 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:57 smithi043 ceph-mon[29167]: Deploying daemon mds.h on smithi112 2024-04-25T20:45:57.468 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:57 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:boot 2024-04-25T20:45:57.468 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:57 smithi043 ceph-mon[29167]: fsmap 7 up:standby 2024-04-25T20:45:57.468 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:57 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:45:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:58 smithi112 ceph-mon[32322]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:58.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2529251040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:58 smithi195 ceph-mon[33250]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:58 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2529251040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:58.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:58 smithi043 ceph-mon[29167]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:45:58.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:58 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2529251040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:45:58.842 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 20:45:58 smithi112 systemd[1]: Started Ceph mds.h for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:45:59.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:46:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: Deploying daemon mds.i on smithi195 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:boot 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: fsmap 8 up:standby 2024-04-25T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:45:59 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: Deploying daemon mds.i on smithi195 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:boot 2024-04-25T20:46:00.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: fsmap 8 up:standby 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:45:59 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: Deploying daemon mds.i on smithi195 2024-04-25T20:46:00.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:boot 2024-04-25T20:46:00.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: fsmap 8 up:standby 2024-04-25T20:46:00.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:45:59 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:46:00.096 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:01.092 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:00 smithi195 systemd[1]: Starting Ceph mds.i for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:46:01.402 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 podman[64316]: 2024-04-25 20:46:01.039694719 +0000 UTC m=+0.018542946 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:46:01.402 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 podman[64316]: 2024-04-25 20:46:01.161113317 +0000 UTC m=+0.139961534 container create 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 podman[64316]: 2024-04-25 20:46:01.521832145 +0000 UTC m=+0.500680373 container init 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 podman[64316]: 2024-04-25 20:46:01.52452719 +0000 UTC m=+0.503375409 container start 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 ceph-mds[64335]: -- 172.21.15.195:0/2357390393 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef99d1ba40 con 0x55ef99cee800 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: starting mds.i at 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 bash[64316]: 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 2024-04-25T20:46:01.684 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 20:46:01 smithi195 systemd[1]: Started Ceph mds.i for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:46:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 -- 172.21.15.43:0/3929305521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c01019d0 msgr2=0x7f37c010f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 --2- 172.21.15.43:0/3929305521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c01019d0 0x7f37c010f910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37b800b0a0 tx=0x7f37b800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 -- 172.21.15.43:0/3929305521 shutdown_connections 2024-04-25T20:46:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 --2- 172.21.15.43:0/3929305521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c01019d0 0x7f37c010f910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 --2- 172.21.15.43:0/3929305521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0108ad0 0x7f37c0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 --2- 172.21.15.43:0/3929305521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c0101030 0x7f37c0101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 -- 172.21.15.43:0/3929305521 >> 172.21.15.43:0/3929305521 conn(0x7f37c0077fb0 msgr2=0x7f37c00ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:01.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 -- 172.21.15.43:0/3929305521 shutdown_connections 2024-04-25T20:46:01.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.822+0000 7f37c6817700 1 -- 172.21.15.43:0/3929305521 wait complete. 2024-04-25T20:46:01.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:01 smithi043 ceph-mon[29167]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:01.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:01 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:01.825 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:01 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:01.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.823+0000 7f37c6817700 1 Processor -- start 2024-04-25T20:46:01.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.823+0000 7f37c6817700 1 -- start start 2024-04-25T20:46:01.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0101030 0x7f37c0102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c01019d0 0x7f37c0102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0112d60 con 0x7f37c0108ad0 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0112be0 con 0x7f37c0101030 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c6817700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0112ee0 con 0x7f37c01019d0 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60780/0 (socket says 172.21.15.43:60780) 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 -- 172.21.15.43:0/1855099608 learned_addr learned my addr 172.21.15.43:0/1855099608 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37bf7fe700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c01019d0 0x7f37c0102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37bffff700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0101030 0x7f37c0102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 -- 172.21.15.43:0/1855099608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c01019d0 msgr2=0x7f37c0102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c01019d0 0x7f37c0102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 -- 172.21.15.43:0/1855099608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0101030 msgr2=0x7f37c0102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:01.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0101030 0x7f37c0102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 -- 172.21.15.43:0/1855099608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c01a7740 con 0x7f37c0108ad0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.824+0000 7f37c4db4700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37b8006070 tx=0x7f37b8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.825+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8021070 con 0x7f37c0108ad0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.825+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37b8007e50 con 0x7f37c0108ad0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.825+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b80046d0 con 0x7f37c0108ad0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.825+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c01a79d0 con 0x7f37c0108ad0 2024-04-25T20:46:01.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.825+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c01a7dc0 con 0x7f37c0108ad0 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.826+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c010aeb0 con 0x7f37c0108ad0 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.827+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f37b8007980 con 0x7f37c0108ad0 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.828+0000 7f37bd7fa700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 0x7f37a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.828+0000 7f37bffff700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 0x7f37a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.828+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f37b800f020 con 0x7f37c0108ad0 2024-04-25T20:46:01.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.828+0000 7f37bffff700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 0x7f37a80a6100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005950 tx=0x7f37b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:01.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:01.834+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f37b802a020 con 0x7f37c0108ad0 2024-04-25T20:46:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:01 smithi195 ceph-mon[33250]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:02.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:01 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:01 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:01 smithi112 ceph-mon[32322]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:01 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:01 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.104+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37c0103740 con 0x7f37c0108ad0 2024-04-25T20:46:02.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.105+0000 7f37bd7fa700 1 -- 172.21.15.43:0/1855099608 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7f37b8007c70 con 0x7f37c0108ad0 2024-04-25T20:46:02.106 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:02.107 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 msgr2=0x7f37a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 0x7f37a80a6100 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005950 tx=0x7f37b000b410 comp rx=0 tx=0).stop 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 msgr2=0x7f37c0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37b8006070 tx=0x7f37b8004d00 comp rx=0 tx=0).stop 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 shutdown_connections 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f37a80a3c40 0x7f37a80a6100 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:02.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37c0108ad0 0x7f37c0102c90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37c0101030 0x7f37c0102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 --2- 172.21.15.43:0/1855099608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37c01019d0 0x7f37c0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 >> 172.21.15.43:0/1855099608 conn(0x7f37c0077fb0 msgr2=0x7f37c00ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 shutdown_connections 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:02.107+0000 7f37c6817700 1 -- 172.21.15.43:0/1855099608 wait complete. 2024-04-25T20:46:02.110 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 10 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:boot 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: fsmap 9 up:standby 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: Deploying daemon mds.g on smithi043 2024-04-25T20:46:02.778 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:02 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1855099608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:02.943 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:boot 2024-04-25T20:46:02.943 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: fsmap 9 up:standby 2024-04-25T20:46:02.943 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:46:02.943 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:02.944 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:02.944 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:02.944 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:02.944 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: Deploying daemon mds.g on smithi043 2024-04-25T20:46:02.944 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:02 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1855099608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:03.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:boot 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: fsmap 9 up:standby 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: Deploying daemon mds.g on smithi043 2024-04-25T20:46:03.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:02 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1855099608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:03.952 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:03 smithi043 ceph-mon[29167]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:03 smithi195 ceph-mon[33250]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:03 smithi112 ceph-mon[32322]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:04.545 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:04 smithi043 systemd[1]: Starting Ceph mds.g for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:46:04.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:46:04.974 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:04 smithi043 podman[71498]: 2024-04-25 20:46:04.587190044 +0000 UTC m=+0.017991249 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:46:04.974 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:04 smithi043 podman[71498]: 2024-04-25 20:46:04.704845228 +0000 UTC m=+0.135646478 container create 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T20:46:04.974 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:04 smithi043 podman[71498]: 2024-04-25 20:46:04.974386257 +0000 UTC m=+0.405187478 container init 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T20:46:05.168 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:05.292 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:04 smithi043 podman[71498]: 2024-04-25 20:46:04.97751558 +0000 UTC m=+0.408316794 container start 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T20:46:05.292 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:05 smithi043 ceph-mds[71543]: -- 172.21.15.43:0/2382047084 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643202dda40 con 0x5643202b1000 2024-04-25T20:46:05.292 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: starting mds.g at 2024-04-25T20:46:05.292 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:05 smithi043 bash[71498]: 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb 2024-04-25T20:46:05.292 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 20:46:05 smithi043 systemd[1]: Started Ceph mds.g for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: Deploying daemon mds.a on smithi043 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6838/283016818,v1:172.21.15.43:6839/283016818] up:boot 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: fsmap 10 up:standby 2024-04-25T20:46:06.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:06 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: Deploying daemon mds.a on smithi043 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6838/283016818,v1:172.21.15.43:6839/283016818] up:boot 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: fsmap 10 up:standby 2024-04-25T20:46:06.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:06 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: Deploying daemon mds.a on smithi043 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6838/283016818,v1:172.21.15.43:6839/283016818] up:boot 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: fsmap 10 up:standby 2024-04-25T20:46:06.593 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:06 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 -- 172.21.15.43:0/4122477497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac101940 msgr2=0x7f6dac101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 --2- 172.21.15.43:0/4122477497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac101940 0x7f6dac101dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009990 tx=0x7f6d94009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 -- 172.21.15.43:0/4122477497 shutdown_connections 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 --2- 172.21.15.43:0/4122477497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac102300 0x7f6dac10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 --2- 172.21.15.43:0/4122477497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac107990 0x7f6dac107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 --2- 172.21.15.43:0/4122477497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac101940 0x7f6dac101dc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 -- 172.21.15.43:0/4122477497 >> 172.21.15.43:0/4122477497 conn(0x7f6dac0788f0 msgr2=0x7f6dac078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 -- 172.21.15.43:0/4122477497 shutdown_connections 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.908+0000 7f6db29f3700 1 -- 172.21.15.43:0/4122477497 wait complete. 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 Processor -- start 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 -- start start 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac101940 0x7f6dac19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 0x7f6dac19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac111ce0 con 0x7f6dac107990 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac111b60 con 0x7f6dac102300 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db29f3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac111e60 con 0x7f6dac101940 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db0f90700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db0f90700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39410/0 (socket says 172.21.15.43:39410) 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.909+0000 7f6db0f90700 1 -- 172.21.15.43:0/2098772885 learned_addr learned my addr 172.21.15.43:0/2098772885 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6dab7fe700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 0x7f6dac19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6dabfff700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac101940 0x7f6dac19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 -- 172.21.15.43:0/2098772885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac101940 msgr2=0x7f6dac19a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac101940 0x7f6dac19a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 -- 172.21.15.43:0/2098772885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 msgr2=0x7f6dac19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 0x7f6dac19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 -- 172.21.15.43:0/2098772885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac197f70 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6dab7fe700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 0x7f6dac19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db0f90700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6da400b970 tx=0x7f6da400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4019070 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac198260 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6da4014440 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40075d0 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.910+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac198750 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.911+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac103060 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.913+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6da401c070 con 0x7f6dac107990 2024-04-25T20:46:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.914+0000 7f6da97fa700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 0x7f6d980a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.914+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f6da40cf8f0 con 0x7f6dac107990 2024-04-25T20:46:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.914+0000 7f6dabfff700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 0x7f6d980a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.915+0000 7f6dabfff700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 0x7f6d980a6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c005fd0 tx=0x7f6d9c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:07.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:06.920+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6da409c6d0 con 0x7f6dac107990 2024-04-25T20:46:07.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.176+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dac06acc0 con 0x7f6dac107990 2024-04-25T20:46:07.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.177+0000 7f6da97fa700 1 -- 172.21.15.43:0/2098772885 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8830 (secure 0 0 0) 0x7f6da409bfd0 con 0x7f6dac107990 2024-04-25T20:46:07.178 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:07.178 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 msgr2=0x7f6d980a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 0x7f6d980a6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c005fd0 tx=0x7f6d9c00a560 comp rx=0 tx=0).stop 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 msgr2=0x7f6dac1a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6da400b970 tx=0x7f6da400bd30 comp rx=0 tx=0).stop 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 shutdown_connections 2024-04-25T20:46:07.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6d980a3cc0 0x7f6d980a6180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6dac101940 0x7f6dac19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dac107990 0x7f6dac1a5200 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 --2- 172.21.15.43:0/2098772885 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6dac102300 0x7f6dac19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 >> 172.21.15.43:0/2098772885 conn(0x7f6dac0788f0 msgr2=0x7f6dac0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 shutdown_connections 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:07.179+0000 7f6db29f3700 1 -- 172.21.15.43:0/2098772885 wait complete. 2024-04-25T20:46:07.181 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 11 2024-04-25T20:46:08.381 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:08 smithi043 ceph-mon[29167]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:08.382 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:08 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2098772885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:08.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:08 smithi195 ceph-mon[33250]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:08.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:08 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2098772885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:08 smithi112 ceph-mon[32322]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:08.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:08 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2098772885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:08.930 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:08 smithi043 systemd[1]: Starting Ceph mds.a for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T20:46:09.266 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 podman[71961]: 2024-04-25 20:46:09.037408456 +0000 UTC m=+0.019020935 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T20:46:09.266 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 podman[71961]: 2024-04-25 20:46:09.147522388 +0000 UTC m=+0.129134845 container create f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True) 2024-04-25T20:46:09.794 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 podman[71961]: 2024-04-25 20:46:09.391911629 +0000 UTC m=+0.373524086 container init f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T20:46:09.795 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 podman[71961]: 2024-04-25 20:46:09.394645957 +0000 UTC m=+0.376258415 container start f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5) 2024-04-25T20:46:09.795 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 ceph-mds[71980]: -- 172.21.15.43:0/1803088878 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55666c733a40 con 0x55666c706800 2024-04-25T20:46:09.795 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: starting mds.a at 2024-04-25T20:46:09.795 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 bash[71961]: f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 2024-04-25T20:46:09.795 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 20:46:09 smithi043 systemd[1]: Started Ceph mds.a for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:46:10.494 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:10.494 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.494 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.494 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:10.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:10.495 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:10 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:10.546 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:10 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:10.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T20:46:10.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T20:46:10.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:10 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:10.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:46:11.234 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:11.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:11 smithi043 ceph-mon[29167]: Deploying daemon mds.b on smithi112 2024-04-25T20:46:11.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:11 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6840/2354201113,v1:172.21.15.43:6841/2354201113] up:boot 2024-04-25T20:46:11.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:11 smithi043 ceph-mon[29167]: fsmap 11 up:standby 2024-04-25T20:46:11.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:11 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:46:11.458 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:11 smithi112 ceph-mon[32322]: Deploying daemon mds.b on smithi112 2024-04-25T20:46:11.458 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:11 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6840/2354201113,v1:172.21.15.43:6841/2354201113] up:boot 2024-04-25T20:46:11.458 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:11 smithi112 ceph-mon[32322]: fsmap 11 up:standby 2024-04-25T20:46:11.458 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:11 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:46:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:11 smithi195 ceph-mon[33250]: Deploying daemon mds.b on smithi112 2024-04-25T20:46:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:11 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6840/2354201113,v1:172.21.15.43:6841/2354201113] up:boot 2024-04-25T20:46:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:11 smithi195 ceph-mon[33250]: fsmap 11 up:standby 2024-04-25T20:46:11.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:11 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:46:12.093 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 podman[62588]: 2024-04-25 20:46:12.06059215 +0000 UTC m=+0.136208698 container create ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-25T20:46:12.422 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:12 smithi112 ceph-mon[32322]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:12.422 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 podman[62588]: 2024-04-25 20:46:12.32178158 +0000 UTC m=+0.397398086 container init ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T20:46:12.422 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 podman[62588]: 2024-04-25 20:46:12.324242848 +0000 UTC m=+0.399859355 container start ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T20:46:12.422 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 ceph-mds[62607]: -- 172.21.15.112:0/4021295801 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d94457ba40 con 0x55d94454e800 2024-04-25T20:46:12.422 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: starting mds.b at 2024-04-25T20:46:12.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:12 smithi043 ceph-mon[29167]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:12.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:12 smithi195 ceph-mon[33250]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:12.842 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 bash[62588]: ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c 2024-04-25T20:46:12.842 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:12 smithi112 systemd[1]: Started Ceph mds.b for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T20:46:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 -- 172.21.15.43:0/1023498736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0107990 msgr2=0x7f83b0107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 --2- 172.21.15.43:0/1023498736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0107990 0x7f83b0107d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009990 tx=0x7f83ac009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 -- 172.21.15.43:0/1023498736 shutdown_connections 2024-04-25T20:46:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 --2- 172.21.15.43:0/1023498736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0102300 0x7f83b010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 --2- 172.21.15.43:0/1023498736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0107990 0x7f83b0107d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 --2- 172.21.15.43:0/1023498736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0101940 0x7f83b0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.943+0000 7f83b819e700 1 -- 172.21.15.43:0/1023498736 >> 172.21.15.43:0/1023498736 conn(0x7f83b00788f0 msgr2=0x7f83b0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- 172.21.15.43:0/1023498736 shutdown_connections 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- 172.21.15.43:0/1023498736 wait complete. 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 Processor -- start 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- start start 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 0x7f83b0103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 0x7f83b0103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0111c10 con 0x7f83b0102300 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0111a90 con 0x7f83b0107990 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.944+0000 7f83b819e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0111d90 con 0x7f83b0101940 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5739700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 0x7f83b0103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:49714/0 (socket says 172.21.15.43:49714) 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 -- 172.21.15.43:0/4063580234 learned_addr learned my addr 172.21.15.43:0/4063580234 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b673b700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 0x7f83b0103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 -- 172.21.15.43:0/4063580234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 msgr2=0x7f83b0103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 0x7f83b0103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 -- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 msgr2=0x7f83b0103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 0x7f83b0103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 -- 172.21.15.43:0/4063580234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b01a76e0 con 0x7f83b0101940 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5739700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 0x7f83b0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b673b700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 0x7f83b0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b5f3a700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83ac005f50 tx=0x7f83ac0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac026070 con 0x7f83b0101940 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f83ac00fb40 con 0x7f83b0101940 2024-04-25T20:46:12.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b01a7970 con 0x7f83b0101940 2024-04-25T20:46:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.946+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b01a7e50 con 0x7f83b0101940 2024-04-25T20:46:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.945+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0173f0 con 0x7f83b0101940 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.946+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b0069730 con 0x7f83b0101940 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.948+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f83ac029070 con 0x7f83b0101940 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.948+0000 7f83a6ffd700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 0x7f839c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.948+0000 7f83b5739700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 0x7f839c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.948+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f83ac0d0b60 con 0x7f83b0101940 2024-04-25T20:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.949+0000 7f83b5739700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 0x7f839c0a6100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b0078df0 tx=0x7f83a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:12.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:12.952+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f83ac013070 con 0x7f83b0101940 2024-04-25T20:46:13.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.220+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83b01a8080 con 0x7f83b0101940 2024-04-25T20:46:13.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.221+0000 7f83a6ffd700 1 -- 172.21.15.43:0/4063580234 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10485 (secure 0 0 0) 0x7f83ac09d9d0 con 0x7f83b0101940 2024-04-25T20:46:13.221 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:13.221 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24448,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-25T20:46:13.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.223+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 msgr2=0x7f839c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:13.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.223+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 0x7f839c0a6100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b0078df0 tx=0x7f83a0009260 comp rx=0 tx=0).stop 2024-04-25T20:46:13.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.223+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 msgr2=0x7f83b01034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:13.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.223+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83ac005f50 tx=0x7f83ac0057c0 comp rx=0 tx=0).stop 2024-04-25T20:46:13.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 shutdown_connections 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f839c0a3c40 0x7f839c0a6100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83b0101940 0x7f83b01034f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83b0107990 0x7f83b0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 --2- 172.21.15.43:0/4063580234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b0102300 0x7f83b0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 >> 172.21.15.43:0/4063580234 conn(0x7f83b00788f0 msgr2=0x7f83b006a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 shutdown_connections 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:13.224+0000 7f83b819e700 1 -- 172.21.15.43:0/4063580234 wait complete. 2024-04-25T20:46:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 13 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:boot 2024-04-25T20:46:13.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: fsmap 12 up:standby 2024-04-25T20:46:13.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:46:13.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:13 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4063580234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.717 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:boot 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: fsmap 12 up:standby 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:46:13.718 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:13 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4063580234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:boot 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: fsmap 12 up:standby 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:46:13.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:13 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4063580234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:46:13.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-04-25T20:46:14.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:14 smithi043 ceph-mon[29167]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:14 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.629 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:14.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:14 smithi195 ceph-mon[33250]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:14.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:14 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:14 smithi112 ceph-mon[32322]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:14 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:15.946 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:15 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:15.946 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:15 smithi043 ceph-mon[29167]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:15 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:15 smithi195 ceph-mon[33250]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:15 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:15 smithi112 ceph-mon[32322]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:16.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- 172.21.15.43:0/790634003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9810108a60 msgr2=0x7f9810108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:16.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 --2- 172.21.15.43:0/790634003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9810108a60 0x7f9810108e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9808009990 tx=0x7f9808009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- 172.21.15.43:0/790634003 shutdown_connections 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 --2- 172.21.15.43:0/790634003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f981010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 --2- 172.21.15.43:0/790634003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9810108a60 0x7f9810108e40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 --2- 172.21.15.43:0/790634003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f981006b1f0 0x7f981006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- 172.21.15.43:0/790634003 >> 172.21.15.43:0/790634003 conn(0x7f98100789e0 msgr2=0x7f9810078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- 172.21.15.43:0/790634003 shutdown_connections 2024-04-25T20:46:16.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- 172.21.15.43:0/790634003 wait complete. 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 Processor -- start 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.328+0000 7f9817639700 1 -- start start 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f9810199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9810108a60 0x7f981019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9810112db0 con 0x7f981006b1f0 2024-04-25T20:46:16.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9810112c30 con 0x7f9810108a60 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9810112f30 con 0x7f981006bbb0 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56720/0 (socket says 172.21.15.43:56720) 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 -- 172.21.15.43:0/2236672811 learned_addr learned my addr 172.21.15.43:0/2236672811 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9814bd4700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f9810199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9815bd6700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9810108a60 0x7f981019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:16.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 -- 172.21.15.43:0/2236672811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 msgr2=0x7f9810199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f9810199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 -- 172.21.15.43:0/2236672811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9810108a60 msgr2=0x7f981019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9810108a60 0x7f981019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 -- 172.21.15.43:0/2236672811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981019e210 con 0x7f981006b1f0 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9814bd4700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f9810199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:46:16.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f98153d5700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9808000c00 tx=0x7f9808009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808027070 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9808003fb0 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981019e4a0 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9808022d80 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.329+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101a5d80 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.330+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981010b060 con 0x7f981006b1f0 2024-04-25T20:46:16.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.331+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f980802a070 con 0x7f981006b1f0 2024-04-25T20:46:16.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.332+0000 7f980e7fc700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 0x7f97f80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:16.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.332+0000 7f9814bd4700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 0x7f97f80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:16.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.332+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f98080d0c80 con 0x7f981006b1f0 2024-04-25T20:46:16.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.333+0000 7f9814bd4700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 0x7f97f80a6180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9804005950 tx=0x7f98040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:16.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.337+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f980805eff0 con 0x7f981006b1f0 2024-04-25T20:46:16.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.556+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f981019a560 con 0x7f981006b1f0 2024-04-25T20:46:16.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.556+0000 7f980e7fc700 1 -- 172.21.15.43:0/2236672811 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f9808013070 con 0x7f981006b1f0 2024-04-25T20:46:16.557 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:16.557 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-04-25T20:46:16.558 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T20:46:16.558 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-04-25T20:46:16.558 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-04-25T20:46:16.558 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:46:16.558 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 msgr2=0x7f97f80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 0x7f97f80a6180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9804005950 tx=0x7f98040058e0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 msgr2=0x7f9810199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9808000c00 tx=0x7f9808009f90 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 shutdown_connections 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f97f80a3cc0 0x7f97f80a6180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9810108a60 0x7f981019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f981006b1f0 0x7f9810199200 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 --2- 172.21.15.43:0/2236672811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f981006bbb0 0x7f9810199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 >> 172.21.15.43:0/2236672811 conn(0x7f98100789e0 msgr2=0x7f98100ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 shutdown_connections 2024-04-25T20:46:16.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:16.559+0000 7f9817639700 1 -- 172.21.15.43:0/2236672811 wait complete. 2024-04-25T20:46:16.939 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:16 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2236672811' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T20:46:16.939 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:16.939 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:16 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:17.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:16 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2236672811' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T20:46:17.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:17.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:16 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:17.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:16 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2236672811' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T20:46:17.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:17.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:16 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:17.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T20:46:17.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T20:46:17.546 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:17.917 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:17 smithi043 ceph-mon[29167]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:17.917 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:17.917 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:17.918 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:17 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:17 smithi195 ceph-mon[33250]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:17 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:17 smithi112 ceph-mon[32322]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:17 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:18.773 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:18 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:18.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:18 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:18.995 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:18 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:46:19.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 -- 172.21.15.43:0/1969045173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 msgr2=0x7fd2ec102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:19.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 --2- 172.21.15.43:0/1969045173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec102f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009990 tx=0x7fd2dc009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 -- 172.21.15.43:0/1969045173 shutdown_connections 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 --2- 172.21.15.43:0/1969045173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 --2- 172.21.15.43:0/1969045173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec103480 0x7fd2ec10f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 --2- 172.21.15.43:0/1969045173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec102f40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 -- 172.21.15.43:0/1969045173 >> 172.21.15.43:0/1969045173 conn(0x7fd2ec079bf0 msgr2=0x7fd2ec07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 -- 172.21.15.43:0/1969045173 shutdown_connections 2024-04-25T20:46:19.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.232+0000 7fd2f3716700 1 -- 172.21.15.43:0/1969045173 wait complete. 2024-04-25T20:46:19.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 Processor -- start 2024-04-25T20:46:19.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 -- start start 2024-04-25T20:46:19.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:19.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 0x7fd2ec199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:19.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:19.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec112e10 con 0x7fd2ec102ac0 2024-04-25T20:46:19.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec112c90 con 0x7fd2ec108ab0 2024-04-25T20:46:19.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f3716700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec112f90 con 0x7fd2ec103480 2024-04-25T20:46:19.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f14b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:19.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f14b2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56734/0 (socket says 172.21.15.43:56734) 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f14b2700 1 -- 172.21.15.43:0/359635351 learned_addr learned my addr 172.21.15.43:0/359635351 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f1cb3700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.233+0000 7fd2f0cb1700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 0x7fd2ec199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 -- 172.21.15.43:0/359635351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 msgr2=0x7fd2ec199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 0x7fd2ec199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 -- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 msgr2=0x7fd2ec199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 -- 172.21.15.43:0/359635351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec19e200 con 0x7fd2ec108ab0 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f14b2700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f0cb1700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 0x7fd2ec199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f1cb3700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec19dac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400efc0 tx=0x7fd2e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:19.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40092e0 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2e4004bb0 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4004280 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.234+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec19e490 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.235+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec074c70 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.235+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec10b040 con 0x7fd2ec108ab0 2024-04-25T20:46:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.237+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fd2e401b030 con 0x7fd2ec108ab0 2024-04-25T20:46:19.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.237+0000 7fd2e27fc700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 0x7fd2d80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:19.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.237+0000 7fd2f14b2700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 0x7fd2d80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:19.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.237+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd2e40d0470 con 0x7fd2ec108ab0 2024-04-25T20:46:19.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.238+0000 7fd2f14b2700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 0x7fd2d80a6180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80104e0 tx=0x7fd2e800b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:19.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.241+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd2e4022020 con 0x7fd2ec108ab0 2024-04-25T20:46:19.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:19.466+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd2ec069730 con 0x7fd2ec108ab0 2024-04-25T20:46:20.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.418+0000 7fd2e27fc700 1 -- 172.21.15.43:0/359635351 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fd2e4010040 con 0x7fd2ec108ab0 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.422+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 msgr2=0x7fd2d80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.422+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 0x7fd2d80a6180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80104e0 tx=0x7fd2e800b480 comp rx=0 tx=0).stop 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.422+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 msgr2=0x7fd2ec19dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.422+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec19dac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400efc0 tx=0x7fd2e400c3a0 comp rx=0 tx=0).stop 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 shutdown_connections 2024-04-25T20:46:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2d80a3cc0 0x7fd2d80a6180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2ec108ab0 0x7fd2ec19dac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2ec102ac0 0x7fd2ec199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 --2- 172.21.15.43:0/359635351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2ec103480 0x7fd2ec199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 >> 172.21.15.43:0/359635351 conn(0x7fd2ec079bf0 msgr2=0x7fd2ec100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 shutdown_connections 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:20.423+0000 7fd2f3716700 1 -- 172.21.15.43:0/359635351 wait complete. 2024-04-25T20:46:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-04-25T20:46:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/359635351' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:20.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:20 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/359635351' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:20 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/359635351' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:20.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:20 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T20:46:21.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T20:46:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:21.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T20:46:21.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T20:46:21.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:21.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:21.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:21 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:21.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:21.843 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:21 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T20:46:21.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T20:46:21.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:21.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:46:21.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:46:21.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:21 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:46:22.792 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:22 smithi043 ceph-mon[29167]: pgmap v291: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:22.793 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:22 smithi043 ceph-mon[29167]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T20:46:22.793 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:22 smithi043 ceph-mon[29167]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:22.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:22 smithi195 ceph-mon[33250]: pgmap v291: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:22 smithi195 ceph-mon[33250]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T20:46:22.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:22 smithi195 ceph-mon[33250]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:22 smithi112 ceph-mon[32322]: pgmap v291: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:22 smithi112 ceph-mon[32322]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T20:46:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:22 smithi112 ceph-mon[32322]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/3740863798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc108a30 msgr2=0x7fc9bc108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/3740863798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc108a30 0x7fc9bc108e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009990 tx=0x7fc9b8009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/3740863798 shutdown_connections 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/3740863798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/3740863798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc108a30 0x7fc9bc108e10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/3740863798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc06a750 0x7fc9bc06abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/3740863798 >> 172.21.15.43:0/3740863798 conn(0x7fc9bc0788f0 msgr2=0x7fc9bc078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/3740863798 shutdown_connections 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.379+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/3740863798 wait complete. 2024-04-25T20:46:23.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 Processor -- start 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 -- start start 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 0x7fc9bc199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc108a30 0x7fc9bc19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112df0 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112c70 con 0x7fc9bc108a30 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c3d0f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112f70 con 0x7fc9bc06a750 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56744/0 (socket says 172.21.15.43:56744) 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 -- 172.21.15.43:0/2426915443 learned_addr learned my addr 172.21.15.43:0/2426915443 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c22ac700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc108a30 0x7fc9bc19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c1aab700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 0x7fc9bc199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:23.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 -- 172.21.15.43:0/2426915443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 msgr2=0x7fc9bc199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 0x7fc9bc199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 -- 172.21.15.43:0/2426915443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc108a30 msgr2=0x7fc9bc19dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc108a30 0x7fc9bc19dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 -- 172.21.15.43:0/2426915443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc19e390 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c1aab700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 0x7fc9bc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.380+0000 7fc9c12aa700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00b530 tx=0x7fc9ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.381+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac015020 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.381+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9ac011d00 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.381+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc19e680 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.381+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac010e60 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.381+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc1a5f00 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.382+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc069730 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.384+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc9ac018020 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.384+0000 7fc9b2ffd700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 0x7fc9a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:23.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.384+0000 7fc9c1aab700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 0x7fc9a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:23.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.385+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7497+0+0 (secure 0 0 0) 0x7fc9ac0cfea0 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.385+0000 7fc9c1aab700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 0x7fc9a80a6100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b5c0 tx=0x7fc9b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:23.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.388+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc9ac01f020 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:23.602+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc9bc02df80 con 0x7fc9bc06b0f0 2024-04-25T20:46:23.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:23 smithi043 ceph-mon[29167]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T20:46:23.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:23 smithi195 ceph-mon[33250]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T20:46:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:23 smithi112 ceph-mon[32322]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T20:46:24.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.459+0000 7fc9b2ffd700 1 -- 172.21.15.43:0/2426915443 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7fc9ac09cbb0 con 0x7fc9bc06b0f0 2024-04-25T20:46:24.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.463+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 msgr2=0x7fc9a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.463+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 0x7fc9a80a6100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b5c0 tx=0x7fc9b8005fb0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.463+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 msgr2=0x7fc9bc1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.463+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00b530 tx=0x7fc9ac00b8f0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 shutdown_connections 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc9a80a3c40 0x7fc9a80a6100 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9bc06a750 0x7fc9bc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9bc108a30 0x7fc9bc19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 --2- 172.21.15.43:0/2426915443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc06b0f0 0x7fc9bc1998c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 >> 172.21.15.43:0/2426915443 conn(0x7fc9bc0788f0 msgr2=0x7fc9bc0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 shutdown_connections 2024-04-25T20:46:24.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:24.464+0000 7fc9c3d0f700 1 -- 172.21.15.43:0/2426915443 wait complete. 2024-04-25T20:46:24.467 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-04-25T20:46:24.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:24 smithi043 ceph-mon[29167]: pgmap v294: 33 pgs: 14 active+clean, 7 creating+peering, 12 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:24.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:24 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T20:46:24.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:24 smithi195 ceph-mon[33250]: pgmap v294: 33 pgs: 14 active+clean, 7 creating+peering, 12 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:24.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:24 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T20:46:24.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:24 smithi112 ceph-mon[32322]: pgmap v294: 33 pgs: 14 active+clean, 7 creating+peering, 12 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:24.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:24 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T20:46:25.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T20:46:25.446 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:25.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T20:46:25.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:25 smithi043 ceph-mon[29167]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T20:46:25.473 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:25 smithi043 ceph-mon[29167]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T20:46:25.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T20:46:25.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:25 smithi195 ceph-mon[33250]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T20:46:25.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:25 smithi195 ceph-mon[33250]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T20:46:25.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2426915443' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T20:46:25.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:25 smithi112 ceph-mon[32322]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T20:46:25.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:25 smithi112 ceph-mon[32322]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T20:46:26.651 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:26 smithi043 ceph-mon[29167]: pgmap v296: 97 pgs: 17 active+clean, 7 creating+peering, 73 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:26.652 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:26 smithi043 ceph-mon[29167]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T20:46:26.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:26 smithi195 ceph-mon[33250]: pgmap v296: 97 pgs: 17 active+clean, 7 creating+peering, 73 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:26.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:26 smithi195 ceph-mon[33250]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T20:46:26.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:26 smithi112 ceph-mon[32322]: pgmap v296: 97 pgs: 17 active+clean, 7 creating+peering, 73 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:26.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:26 smithi112 ceph-mon[32322]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T20:46:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 -- 172.21.15.43:0/3375198621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 msgr2=0x7f167010f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 --2- 172.21.15.43:0/3375198621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f167010f8e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f166800b0a0 tx=0x7f166800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 -- 172.21.15.43:0/3375198621 shutdown_connections 2024-04-25T20:46:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 --2- 172.21.15.43:0/3375198621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 0x7f1670108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 --2- 172.21.15.43:0/3375198621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f167010f8e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 --2- 172.21.15.43:0/3375198621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 -- 172.21.15.43:0/3375198621 >> 172.21.15.43:0/3375198621 conn(0x7f1670079b20 msgr2=0x7f1670079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 -- 172.21.15.43:0/3375198621 shutdown_connections 2024-04-25T20:46:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.206+0000 7f1676519700 1 -- 172.21.15.43:0/3375198621 wait complete. 2024-04-25T20:46:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.207+0000 7f1676519700 1 Processor -- start 2024-04-25T20:46:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.207+0000 7f1676519700 1 -- start start 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 0x7f16700757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1670112dd0 con 0x7f16701034b0 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1670112c50 con 0x7f1670102af0 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1676519700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1670112f50 con 0x7f1670108a80 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36976/0 (socket says 172.21.15.43:36976) 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 -- 172.21.15.43:0/962275114 learned_addr learned my addr 172.21.15.43:0/962275114 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166ffff700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f1674ab6700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 0x7f16700757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 -- 172.21.15.43:0/962275114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 msgr2=0x7f16700757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 0x7f16700757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 -- 172.21.15.43:0/962275114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 msgr2=0x7f1670074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166f7fe700 1 -- 172.21.15.43:0/962275114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16701a7710 con 0x7f16701034b0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.208+0000 7f166ffff700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f166f7fe700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f166400d980 tx=0x7f166400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664016070 con 0x7f16701034b0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16701a7a00 con 0x7f16701034b0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1664004d00 con 0x7f16701034b0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664005610 con 0x7f16701034b0 2024-04-25T20:46:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.209+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16701a7f90 con 0x7f16701034b0 2024-04-25T20:46:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.210+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1670069730 con 0x7f16701034b0 2024-04-25T20:46:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.211+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1664004750 con 0x7f16701034b0 2024-04-25T20:46:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.212+0000 7f166d7fa700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 0x7f16580a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.212+0000 7f166ffff700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 0x7f16580a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.212+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7879+0+0 (secure 0 0 0) 0x7f16640d0590 con 0x7f16701034b0 2024-04-25T20:46:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.212+0000 7f166ffff700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 0x7f16580a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16600103d0 tx=0x7f166000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.216+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f166401f020 con 0x7f16701034b0 2024-04-25T20:46:27.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:27.484+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f167002df80 con 0x7f16701034b0 2024-04-25T20:46:27.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:27 smithi043 ceph-mon[29167]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:27.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:27 smithi195 ceph-mon[33250]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:27.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:27 smithi112 ceph-mon[32322]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T20:46:28.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.485+0000 7f166d7fa700 1 -- 172.21.15.43:0/962275114 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f166409d080 con 0x7f16701034b0 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 msgr2=0x7f16580a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 0x7f16580a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16600103d0 tx=0x7f166000b3c0 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 msgr2=0x7f1670075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f166400d980 tx=0x7f166400dc90 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 shutdown_connections 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f16580a3c40 0x7f16580a6100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1670108a80 0x7f16700757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1670102af0 0x7f1670074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 --2- 172.21.15.43:0/962275114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16701034b0 0x7f1670075280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 >> 172.21.15.43:0/962275114 conn(0x7f1670079b20 msgr2=0x7f16701017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 shutdown_connections 2024-04-25T20:46:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:28.490+0000 7f1676519700 1 -- 172.21.15.43:0/962275114 wait complete. 2024-04-25T20:46:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T20:46:28.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:28 smithi043 ceph-mon[29167]: pgmap v299: 97 pgs: 50 active+clean, 8 creating+peering, 39 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:28.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:28 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T20:46:28.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:28 smithi043 ceph-mon[29167]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T20:46:28.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:28 smithi043 ceph-mon[29167]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T20:46:28.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:28 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T20:46:28.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:28 smithi195 ceph-mon[33250]: pgmap v299: 97 pgs: 50 active+clean, 8 creating+peering, 39 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:28 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:28 smithi195 ceph-mon[33250]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:28 smithi195 ceph-mon[33250]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:28 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:28 smithi112 ceph-mon[32322]: pgmap v299: 97 pgs: 50 active+clean, 8 creating+peering, 39 unknown; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:28 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:28 smithi112 ceph-mon[32322]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T20:46:28.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:28 smithi112 ceph-mon[32322]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T20:46:28.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:28 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/962275114' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T20:46:29.372 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:46:29.634 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:29.756 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:29 smithi043 ceph-mon[29167]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T20:46:29.756 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:29 smithi043 ceph-mon[29167]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T20:46:29.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:29 smithi195 ceph-mon[33250]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T20:46:29.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:29 smithi195 ceph-mon[33250]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T20:46:29.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:29 smithi112 ceph-mon[32322]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T20:46:29.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:29 smithi112 ceph-mon[32322]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: pgmap v301: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: Cluster is now healthy 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:active 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:30.790 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:30 smithi043 ceph-mon[29167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:30.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: pgmap v301: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: Cluster is now healthy 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:active 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:30 smithi195 ceph-mon[33250]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: pgmap v301: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: Cluster is now healthy 2024-04-25T20:46:30.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] up:active 2024-04-25T20:46:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:30.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:30 smithi112 ceph-mon[32322]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 -- 172.21.15.43:0/981237535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f176806b0f0 msgr2=0x7f176810f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 --2- 172.21.15.43:0/981237535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f176806b0f0 0x7f176810f900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f176000b0a0 tx=0x7f176000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 -- 172.21.15.43:0/981237535 shutdown_connections 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 --2- 172.21.15.43:0/981237535 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f176806b0f0 0x7f176810f900 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 --2- 172.21.15.43:0/981237535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1768108a30 0x7f1768108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 --2- 172.21.15.43:0/981237535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806a750 0x7f176806abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 -- 172.21.15.43:0/981237535 >> 172.21.15.43:0/981237535 conn(0x7f17680788f0 msgr2=0x7f1768078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 -- 172.21.15.43:0/981237535 shutdown_connections 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.447+0000 7f176d9ab700 1 -- 172.21.15.43:0/981237535 wait complete. 2024-04-25T20:46:31.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 Processor -- start 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 -- start start 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 0x7f1768101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806b0f0 0x7f1768101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1768112d90 con 0x7f1768108a30 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1768112c10 con 0x7f176806a750 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f176d9ab700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1768112f10 con 0x7f176806b0f0 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37006/0 (socket says 172.21.15.43:37006) 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 -- 172.21.15.43:0/2732296178 learned_addr learned my addr 172.21.15.43:0/2732296178 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17667fc700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806b0f0 0x7f1768101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f1766ffd700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 0x7f1768101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:31.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 -- 172.21.15.43:0/2732296178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806b0f0 msgr2=0x7f1768101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806b0f0 0x7f1768101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 -- 172.21.15.43:0/2732296178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 msgr2=0x7f1768101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 0x7f1768101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f17677fe700 1 -- 172.21.15.43:0/2732296178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17681a7690 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.448+0000 7f1766ffd700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 0x7f1768101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f17677fe700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f176000b830 tx=0x7f1760007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760021020 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17681a7920 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f176001db40 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176001bc80 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.449+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17681a7dd0 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.450+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1768069730 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.451+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1760024020 con 0x7f1768108a30 2024-04-25T20:46:31.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.451+0000 7f176c9a9700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 0x7f17500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:31.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.452+0000 7f1766ffd700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 0x7f17500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:31.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.452+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f17600d1740 con 0x7f1768108a30 2024-04-25T20:46:31.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.452+0000 7f1766ffd700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 0x7f17500a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1758005fd0 tx=0x7f1758005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:31.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.456+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f176002b020 con 0x7f1768108a30 2024-04-25T20:46:31.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.666+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f176802df80 con 0x7f1768108a30 2024-04-25T20:46:31.667 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:31 smithi043 ceph-mon[29167]: pgmap v302: 97 pgs: 97 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-25T20:46:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.668+0000 7f176c9a9700 1 -- 172.21.15.43:0/2732296178 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22196 (secure 0 0 0) 0x7f176001be20 con 0x7f1768108a30 2024-04-25T20:46:31.669 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:31.669 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":89,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:46:27.488368+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 msgr2=0x7f17500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 0x7f17500a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1758005fd0 tx=0x7f1758005d40 comp rx=0 tx=0).stop 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 msgr2=0x7f1768102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f176000b830 tx=0x7f1760007a90 comp rx=0 tx=0).stop 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 shutdown_connections 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f17500a3c40 0x7f17500a6100 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1768108a30 0x7f1768102490 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f176806a750 0x7f1768101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 --2- 172.21.15.43:0/2732296178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f176806b0f0 0x7f1768101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 >> 172.21.15.43:0/2732296178 conn(0x7f17680788f0 msgr2=0x7f17680ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 shutdown_connections 2024-04-25T20:46:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:31.670+0000 7f176d9ab700 1 -- 172.21.15.43:0/2732296178 wait complete. 2024-04-25T20:46:31.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:31 smithi195 ceph-mon[33250]: pgmap v302: 97 pgs: 97 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-25T20:46:31.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:31 smithi112 ceph-mon[32322]: pgmap v302: 97 pgs: 97 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-25T20:46:32.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:46:32.637 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:32.759 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:32 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2732296178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:32.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:32 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2732296178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:32.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:32 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2732296178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:33.509 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: 2024-04-25T20:46:33.174+0000 7f9141c7d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T20:46:33.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:33 smithi043 ceph-mon[29167]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-04-25T20:46:33.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:33 smithi195 ceph-mon[33250]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-04-25T20:46:33.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:33 smithi112 ceph-mon[32322]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.515+0000 7fb46eddb700 1 -- 172.21.15.43:0/1686383347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb468108a50 msgr2=0x7fb468108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.515+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1686383347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb468108a50 0x7fb468108e30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb46000b0a0 tx=0x7fb46000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- 172.21.15.43:0/1686383347 shutdown_connections 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1686383347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806bab0 0x7fb46810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1686383347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb468108a50 0x7fb468108e30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1686383347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46806b110 0x7fb46806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- 172.21.15.43:0/1686383347 >> 172.21.15.43:0/1686383347 conn(0x7fb4680788f0 msgr2=0x7fb468078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- 172.21.15.43:0/1686383347 shutdown_connections 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- 172.21.15.43:0/1686383347 wait complete. 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 Processor -- start 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- start start 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb468108a50 0x7fb46819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112d70 con 0x7fb46806bab0 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.516+0000 7fb46eddb700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112bf0 con 0x7fb46806b110 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46eddb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb468112ef0 con 0x7fb468108a50 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46cb77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:34.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46cb77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:43916/0 (socket says 172.21.15.43:43916) 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37020/0 (socket says 172.21.15.43:37020) 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46cb77700 1 -- 172.21.15.43:0/1441831639 learned_addr learned my addr 172.21.15.43:0/1441831639 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46d378700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb468108a50 0x7fb46819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 -- 172.21.15.43:0/1441831639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb468108a50 msgr2=0x7fb46819dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb468108a50 0x7fb46819dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 -- 172.21.15.43:0/1441831639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 msgr2=0x7fb4681991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 -- 172.21.15.43:0/1441831639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46819e1f0 con 0x7fb46806bab0 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46cb77700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb467fff700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c970 tx=0x7fb45000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:34.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450004a30 con 0x7fb46806bab0 2024-04-25T20:46:34.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46819e4e0 con 0x7fb46806bab0 2024-04-25T20:46:34.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4500054f0 con 0x7fb46806bab0 2024-04-25T20:46:34.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.517+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45000eba0 con 0x7fb46806bab0 2024-04-25T20:46:34.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.518+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4681a5d60 con 0x7fb46806bab0 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.518+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb468104190 con 0x7fb46806bab0 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.520+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb450004e40 con 0x7fb46806bab0 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.520+0000 7fb465ffb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 0x7fb4540a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.520+0000 7fb46cb77700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 0x7fb4540a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.520+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fb4500cfcc0 con 0x7fb46806bab0 2024-04-25T20:46:34.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.521+0000 7fb46cb77700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 0x7fb4540a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb46000bf50 tx=0x7fb460006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:34.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.525+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb450014030 con 0x7fb46806bab0 2024-04-25T20:46:34.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.735+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb46802df80 con 0x7fb46806bab0 2024-04-25T20:46:34.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.736+0000 7fb465ffb700 1 -- 172.21.15.43:0/1441831639 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22196 (secure 0 0 0) 0x7fb45009c7f0 con 0x7fb46806bab0 2024-04-25T20:46:34.737 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:46:34.737 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":89,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:46:27.488368+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 msgr2=0x7fb4540a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 0x7fb4540a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb46000bf50 tx=0x7fb460006210 comp rx=0 tx=0).stop 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 msgr2=0x7fb468199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c970 tx=0x7fb45000cc80 comp rx=0 tx=0).stop 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 shutdown_connections 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb4540a3c40 0x7fb4540a6100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb468108a50 0x7fb46819dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb46806b110 0x7fb4681991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 --2- 172.21.15.43:0/1441831639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb46806bab0 0x7fb468199720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.738+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 >> 172.21.15.43:0/1441831639 conn(0x7fb4680788f0 msgr2=0x7fb468100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.739+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 shutdown_connections 2024-04-25T20:46:34.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:34.739+0000 7fb46eddb700 1 -- 172.21.15.43:0/1441831639 wait complete. 2024-04-25T20:46:35.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-04-25T20:46:35.697 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:36.013 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:35 smithi043 ceph-mon[29167]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-25T20:46:36.013 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1441831639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:36.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:35 smithi195 ceph-mon[33250]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-25T20:46:36.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1441831639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:36.110 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:35 smithi112 ceph-mon[32322]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-25T20:46:36.110 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1441831639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 -- 172.21.15.43:0/720245711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 msgr2=0x7f0a501021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 --2- 172.21.15.43:0/720245711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a501021a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009990 tx=0x7f0a44009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 -- 172.21.15.43:0/720245711 shutdown_connections 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 --2- 172.21.15.43:0/720245711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 0x7f0a5010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 --2- 172.21.15.43:0/720245711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 0x7f0a50106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 --2- 172.21.15.43:0/720245711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a501021a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 -- 172.21.15.43:0/720245711 >> 172.21.15.43:0/720245711 conn(0x7f0a500788f0 msgr2=0x7f0a50078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 -- 172.21.15.43:0/720245711 shutdown_connections 2024-04-25T20:46:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.539+0000 7f0a5574b700 1 -- 172.21.15.43:0/720245711 wait complete. 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 Processor -- start 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 -- start start 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 0x7f0a5019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 0x7f0a501a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50111c90 con 0x7f0a50101d20 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50111b10 con 0x7f0a50106990 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a5574b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50111e10 con 0x7f0a501026e0 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60012/0 (socket says 172.21.15.43:60012) 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.540+0000 7f0a4effd700 1 -- 172.21.15.43:0/2594347610 learned_addr learned my addr 172.21.15.43:0/2594347610 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4e7fc700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 0x7f0a5019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4f7fe700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 0x7f0a501a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:37.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 -- 172.21.15.43:0/2594347610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 msgr2=0x7f0a5019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 0x7f0a5019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 -- 172.21.15.43:0/2594347610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 msgr2=0x7f0a501a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 0x7f0a501a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 -- 172.21.15.43:0/2594347610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a501a55f0 con 0x7f0a50101d20 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a4effd700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000d950 tx=0x7f0a4000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40016070 con 0x7f0a50101d20 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a501a5820 con 0x7f0a50101d20 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a4000fd60 con 0x7f0a50101d20 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000e610 con 0x7f0a50101d20 2024-04-25T20:46:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.541+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a501a5d80 con 0x7f0a50101d20 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.542+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a50103080 con 0x7f0a50101d20 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.543+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0a40019070 con 0x7f0a50101d20 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.544+0000 7f0a37fff700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 0x7f0a380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.544+0000 7f0a4e7fc700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 0x7f0a380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.544+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f0a400cfc80 con 0x7f0a50101d20 2024-04-25T20:46:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.544+0000 7f0a4e7fc700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 0x7f0a380a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400b5c0 tx=0x7f0a44005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.548+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0a4009c7b0 con 0x7f0a50101d20 2024-04-25T20:46:37.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:37 smithi043 ceph-mon[29167]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-25T20:46:37.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:37.805+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0a5002df80 con 0x7f0a50101d20 2024-04-25T20:46:38.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:37 smithi195 ceph-mon[33250]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-25T20:46:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:37 smithi112 ceph-mon[32322]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-25T20:46:38.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.726+0000 7f0a37fff700 1 -- 172.21.15.43:0/2594347610 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f0a4009c0b0 con 0x7f0a50101d20 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 msgr2=0x7f0a380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 0x7f0a380a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400b5c0 tx=0x7f0a44005960 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 msgr2=0x7f0a5019a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000d950 tx=0x7f0a4000dc60 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 shutdown_connections 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0a380a3c40 0x7f0a380a6100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0a50106990 0x7f0a501a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a50101d20 0x7f0a5019a030 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 --2- 172.21.15.43:0/2594347610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a501026e0 0x7f0a5019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 >> 172.21.15.43:0/2594347610 conn(0x7f0a500788f0 msgr2=0x7f0a50100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 shutdown_connections 2024-04-25T20:46:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:38.729+0000 7f0a5574b700 1 -- 172.21.15.43:0/2594347610 wait complete. 2024-04-25T20:46:39.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:38 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T20:46:39.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:38 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T20:46:39.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:38 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T20:46:39.507 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-04-25T20:46:39.508 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-04-25T20:46:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:39 smithi043 ceph-mon[29167]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-25T20:46:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:39 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T20:46:40.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:39 smithi043 ceph-mon[29167]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:39 smithi195 ceph-mon[33250]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:39 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:39 smithi195 ceph-mon[33250]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:39 smithi112 ceph-mon[32322]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:39 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2594347610' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T20:46:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:39 smithi112 ceph-mon[32322]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T20:46:41.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 -- 172.21.15.43:0/2456346625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14102300 msgr2=0x7fde1410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:41.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/2456346625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14102300 0x7fde1410e7f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00b0a0 tx=0x7fde0c00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 -- 172.21.15.43:0/2456346625 shutdown_connections 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/2456346625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14107990 0x7fde14107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/2456346625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14102300 0x7fde1410e7f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/2456346625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 0x7fde14101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 -- 172.21.15.43:0/2456346625 >> 172.21.15.43:0/2456346625 conn(0x7fde140788f0 msgr2=0x7fde14078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 -- 172.21.15.43:0/2456346625 shutdown_connections 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.668+0000 7fde1a8c7700 1 -- 172.21.15.43:0/2456346625 wait complete. 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 Processor -- start 2024-04-25T20:46:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 -- start start 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 0x7fde141034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14102300 0x7fde14103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde14111c70 con 0x7fde14107990 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fde14111af0 con 0x7fde14101940 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.669+0000 7fde1a8c7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fde14111df0 con 0x7fde14102300 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60038/0 (socket says 172.21.15.43:60038) 2024-04-25T20:46:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 -- 172.21.15.43:0/4259289378 learned_addr learned my addr 172.21.15.43:0/4259289378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde13fff700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 0x7fde141034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde137fe700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14102300 0x7fde14103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 -- 172.21.15.43:0/4259289378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14102300 msgr2=0x7fde14103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14102300 0x7fde14103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 -- 172.21.15.43:0/4259289378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 msgr2=0x7fde141034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 0x7fde141034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 -- 172.21.15.43:0/4259289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde141a76e0 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde18e64700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00b070 tx=0x7fde0c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c021070 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde0c007e50 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde141a7970 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c01ba90 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.670+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde141a7e20 con 0x7fde14107990 2024-04-25T20:46:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.671+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde14069730 con 0x7fde14107990 2024-04-25T20:46:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.672+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fde0c024070 con 0x7fde14107990 2024-04-25T20:46:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.673+0000 7fde117fa700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 0x7fddfc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.673+0000 7fde13fff700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 0x7fddfc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.673+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fde0c00f020 con 0x7fde14107990 2024-04-25T20:46:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.673+0000 7fde13fff700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 0x7fddfc0a6100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde040045b0 tx=0x7fde0400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:41.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.678+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fde0c02b020 con 0x7fde14107990 2024-04-25T20:46:41.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:41.933+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fde141a7ff0 con 0x7fde14107990 2024-04-25T20:46:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:41 smithi043 ceph-mon[29167]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-25T20:46:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:41 smithi195 ceph-mon[33250]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-25T20:46:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:41 smithi112 ceph-mon[32322]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-25T20:46:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.461+0000 7fde117fa700 1 -- 172.21.15.43:0/4259289378 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fde0c09e400 con 0x7fde14107990 2024-04-25T20:46:42.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 msgr2=0x7fddfc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:42.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 0x7fddfc0a6100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde040045b0 tx=0x7fde0400b3c0 comp rx=0 tx=0).stop 2024-04-25T20:46:42.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 msgr2=0x7fde14103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00b070 tx=0x7fde0c007a20 comp rx=0 tx=0).stop 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 shutdown_connections 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fddfc0a3c40 0x7fddfc0a6100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde14107990 0x7fde14103f70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fde14101940 0x7fde141034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 --2- 172.21.15.43:0/4259289378 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde14102300 0x7fde14103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 >> 172.21.15.43:0/4259289378 conn(0x7fde140788f0 msgr2=0x7fde14100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 shutdown_connections 2024-04-25T20:46:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:42.464+0000 7fde1a8c7700 1 -- 172.21.15.43:0/4259289378 wait complete. 2024-04-25T20:46:43.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-25T20:46:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T20:46:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T20:46:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-25T20:46:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T20:46:43.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:42 smithi043 ceph-mon[29167]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T20:46:43.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:42 smithi195 ceph-mon[33250]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T20:46:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4259289378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-25T20:46:43.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-25T20:46:43.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:42 smithi112 ceph-mon[32322]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-25T20:46:43.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-04-25T20:46:43.557 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:44.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-04-25T20:46:44.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:active 2024-04-25T20:46:44.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T20:46:44.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T20:46:44.798 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T20:46:44.799 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:44 smithi043 ceph-mon[29167]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T20:46:44.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-04-25T20:46:44.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:active 2024-04-25T20:46:44.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:44 smithi195 ceph-mon[33250]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 3 op/s 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] up:active 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-25T20:46:44.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:44 smithi112 ceph-mon[32322]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 -- 172.21.15.43:0/1521033271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 msgr2=0x7f3ce410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/1521033271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce410e7f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b0a0 tx=0x7f3cdc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 -- 172.21.15.43:0/1521033271 shutdown_connections 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/1521033271 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 0x7f3ce4107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/1521033271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce410e7f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/1521033271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce4101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 -- 172.21.15.43:0/1521033271 >> 172.21.15.43:0/1521033271 conn(0x7f3ce40788f0 msgr2=0x7f3ce4078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 -- 172.21.15.43:0/1521033271 shutdown_connections 2024-04-25T20:46:45.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.395+0000 7f3ceb87e700 1 -- 172.21.15.43:0/1521033271 wait complete. 2024-04-25T20:46:45.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 Processor -- start 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 -- start start 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce41034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 0x7f3ce4103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4111c60 con 0x7f3ce4102300 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4111ae0 con 0x7f3ce4101940 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ceb87e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4111de0 con 0x7f3ce4107990 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ce8e19700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ce961a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce41034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ce8e19700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60064/0 (socket says 172.21.15.43:60064) 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ce8e19700 1 -- 172.21.15.43:0/4222315119 learned_addr learned my addr 172.21.15.43:0/4222315119 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.396+0000 7f3ce9e1b700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 0x7f3ce4103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:45.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 -- 172.21.15.43:0/4222315119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 msgr2=0x7f3ce4103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 0x7f3ce4103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 -- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 msgr2=0x7f3ce4103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 -- 172.21.15.43:0/4222315119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce41a76d0 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce8e19700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ce961a700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce41034f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000d750 tx=0x7f3ce000da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0014030 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce41a79c0 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ce00044f0 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0005420 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.397+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce41a7f00 con 0x7f3ce4101940 2024-04-25T20:46:45.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.398+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce4069730 con 0x7f3ce4101940 2024-04-25T20:46:45.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.399+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3ce0004750 con 0x7f3ce4101940 2024-04-25T20:46:45.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.400+0000 7f3cda7fc700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 0x7f3cd00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:45.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.400+0000 7f3ce8e19700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 0x7f3cd00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:45.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.400+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f3ce00cff70 con 0x7f3ce4101940 2024-04-25T20:46:45.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.400+0000 7f3ce8e19700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 0x7f3cd00a6100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ce406b770 tx=0x7f3cd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:45.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.403+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3ce009ca00 con 0x7f3ce4101940 2024-04-25T20:46:45.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:45.665+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f3ce41a8210 con 0x7f3ce4101940 2024-04-25T20:46:45.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:45 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:active 2024-04-25T20:46:45.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:45 smithi043 ceph-mon[29167]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-25T20:46:45.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:45 smithi043 ceph-mon[29167]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T20:46:45.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:45 smithi043 ceph-mon[29167]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-25T20:46:45.666 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:45 smithi043 ceph-mon[29167]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:45 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:active 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:45 smithi195 ceph-mon[33250]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:45 smithi195 ceph-mon[33250]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:45 smithi195 ceph-mon[33250]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:45 smithi195 ceph-mon[33250]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-25T20:46:45.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:45 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] up:active 2024-04-25T20:46:45.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:45 smithi112 ceph-mon[32322]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-25T20:46:45.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:45 smithi112 ceph-mon[32322]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-25T20:46:45.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:45 smithi112 ceph-mon[32322]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-04-25T20:46:45.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:45 smithi112 ceph-mon[32322]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-04-25T20:46:46.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.498+0000 7f3cda7fc700 1 -- 172.21.15.43:0/4222315119 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f3ce009c300 con 0x7f3ce4101940 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.501+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 msgr2=0x7f3cd00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 0x7f3cd00a6100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ce406b770 tx=0x7f3cd4009260 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 msgr2=0x7f3ce41034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce41034f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000d750 tx=0x7f3ce000da60 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 shutdown_connections 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3cd00a3c40 0x7f3cd00a6100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ce4107990 0x7f3ce4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ce4101940 0x7f3ce41034f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 --2- 172.21.15.43:0/4222315119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ce4102300 0x7f3ce4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 >> 172.21.15.43:0/4222315119 conn(0x7f3ce40788f0 msgr2=0x7f3ce41057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 shutdown_connections 2024-04-25T20:46:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:46.502+0000 7f3ceb87e700 1 -- 172.21.15.43:0/4222315119 wait complete. 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: pgmap v309: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:active 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: Cluster is now healthy 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-25T20:46:46.744 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4222315119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:46.745 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:46 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: pgmap v309: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-25T20:46:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:active 2024-04-25T20:46:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-25T20:46:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T20:46:46.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: Cluster is now healthy 2024-04-25T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-04-25T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-25T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-25T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4222315119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:46 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:46.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: pgmap v309: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] up:active 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: Cluster is now healthy 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4222315119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:46.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:46 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T20:46:47.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-04-25T20:46:47.616 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:47.738 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:47 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T20:46:47.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:47 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:active 2024-04-25T20:46:47.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:47 smithi043 ceph-mon[29167]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-25T20:46:47.739 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:47 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:47.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:47 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T20:46:47.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:47 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:active 2024-04-25T20:46:47.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:47 smithi112 ceph-mon[32322]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-25T20:46:47.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:47 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:47.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:47 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T20:46:47.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:47 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] up:active 2024-04-25T20:46:47.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:47 smithi195 ceph-mon[33250]: fsmap cephfs:5 7 up:standby 5 up:active 2024-04-25T20:46:47.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:47 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:48.502 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:48 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: 2024-04-25T20:46:48.175+0000 7f9141c7d700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T20:46:48.502 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 20:46:48 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: 2024-04-25T20:46:48.175+0000 7f9141c7d700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-25T20:46:48.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:48 smithi043 ceph-mon[29167]: pgmap v310: 97 pgs: 97 active+clean; 583 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-25T20:46:48.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:48 smithi195 ceph-mon[33250]: pgmap v310: 97 pgs: 97 active+clean; 583 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-25T20:46:48.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:48 smithi112 ceph-mon[32322]: pgmap v310: 97 pgs: 97 active+clean; 583 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-04-25T20:46:49.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 -- 172.21.15.43:0/1455052070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4102a90 msgr2=0x7f96c4102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:49.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/1455052070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4102a90 0x7f96c4102f10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009990 tx=0x7f96b8009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 -- 172.21.15.43:0/1455052070 shutdown_connections 2024-04-25T20:46:49.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/1455052070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4103450 0x7f96c410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/1455052070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c4108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/1455052070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4102a90 0x7f96c4102f10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 -- 172.21.15.43:0/1455052070 >> 172.21.15.43:0/1455052070 conn(0x7f96c4079ba0 msgr2=0x7f96c4079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 -- 172.21.15.43:0/1455052070 shutdown_connections 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.470+0000 7f96ca7c9700 1 -- 172.21.15.43:0/1455052070 wait complete. 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 Processor -- start 2024-04-25T20:46:49.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 -- start start 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4102a90 0x7f96c4074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c40757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4112da0 con 0x7f96c4103450 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4112c20 con 0x7f96c4108a50 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96ca7c9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4112f20 con 0x7f96c4102a90 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53008/0 (socket says 172.21.15.43:53008) 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96c37fe700 1 -- 172.21.15.43:0/3022142407 learned_addr learned my addr 172.21.15.43:0/3022142407 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96c3fff700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4102a90 0x7f96c4074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.471+0000 7f96c8d66700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c40757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 -- 172.21.15.43:0/3022142407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4102a90 msgr2=0x7f96c4074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4102a90 0x7f96c4074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 -- 172.21.15.43:0/3022142407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 msgr2=0x7f96c40757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c40757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 -- 172.21.15.43:0/3022142407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c41a77c0 con 0x7f96c4103450 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c8d66700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c40757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c37fe700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000c00 tx=0x7f96b80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8027070 con 0x7f96c4103450 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b8022470 con 0x7f96c4103450 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c41a7a50 con 0x7f96c4103450 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8017650 con 0x7f96c4103450 2024-04-25T20:46:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.472+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c41a7f30 con 0x7f96c4103450 2024-04-25T20:46:49.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.474+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c4069730 con 0x7f96c4103450 2024-04-25T20:46:49.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.475+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f96b802a070 con 0x7f96c4103450 2024-04-25T20:46:49.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.475+0000 7f96c17fa700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 0x7f96ac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:49.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.475+0000 7f96c3fff700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 0x7f96ac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:49.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.475+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f96b80d1090 con 0x7f96c4103450 2024-04-25T20:46:49.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.476+0000 7f96c3fff700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 0x7f96ac0a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009be0 tx=0x7f96b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:49.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.481+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96b8013070 con 0x7f96c4103450 2024-04-25T20:46:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:49.737+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f96c402df80 con 0x7f96c4103450 2024-04-25T20:46:50.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.508+0000 7f96c17fa700 1 -- 172.21.15.43:0/3022142407 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f96b809dc50 con 0x7f96c4103450 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.511+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 msgr2=0x7f96ac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.511+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 0x7f96ac0a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009be0 tx=0x7f96b4009260 comp rx=0 tx=0).stop 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.511+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 msgr2=0x7f96c4075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.511+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000c00 tx=0x7f96b80047b0 comp rx=0 tx=0).stop 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 shutdown_connections 2024-04-25T20:46:50.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96ac0a3c40 0x7f96ac0a6100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4102a90 0x7f96c4074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96c4108a50 0x7f96c40757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 --2- 172.21.15.43:0/3022142407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96c4103450 0x7f96c4075280 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 >> 172.21.15.43:0/3022142407 conn(0x7f96c4079ba0 msgr2=0x7f96c4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 shutdown_connections 2024-04-25T20:46:50.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:50.512+0000 7f96ca7c9700 1 -- 172.21.15.43:0/3022142407 wait complete. 2024-04-25T20:46:50.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:50 smithi043 ceph-mon[29167]: pgmap v311: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-04-25T20:46:50.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:50 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T20:46:50.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:50 smithi195 ceph-mon[33250]: pgmap v311: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-04-25T20:46:50.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:50 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T20:46:50.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:50 smithi112 ceph-mon[32322]: pgmap v311: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-04-25T20:46:50.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:50 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T20:46:51.343 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-04-25T20:46:51.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-04-25T20:46:51.600 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:51.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T20:46:51.722 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:51 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:51.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T20:46:51.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:51 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3022142407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T20:46:51.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:51 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:46:52.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:52 smithi043 ceph-mon[29167]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-04-25T20:46:52.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:52 smithi195 ceph-mon[33250]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-04-25T20:46:52.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:52 smithi112 ceph-mon[32322]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-04-25T20:46:53.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/3172227022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 msgr2=0x7fe2c010f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/3172227022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c010f900 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800b0a0 tx=0x7fe2b800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/3172227022 shutdown_connections 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/3172227022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c010f900 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/3172227022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c0108a30 0x7fe2c0108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/3172227022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c006a750 0x7fe2c006abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.437+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/3172227022 >> 172.21.15.43:0/3172227022 conn(0x7fe2c00788f0 msgr2=0x7fe2c0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.438+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/3172227022 shutdown_connections 2024-04-25T20:46:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.438+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/3172227022 wait complete. 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.438+0000 7fe2c6e1d700 1 Processor -- start 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 -- start start 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c006a750 0x7fe2c0199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c0108a30 0x7fe2c019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0112d50 con 0x7fe2c006b0f0 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0112bd0 con 0x7fe2c006a750 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c6e1d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0112ed0 con 0x7fe2c0108a30 2024-04-25T20:46:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53014/0 (socket says 172.21.15.43:53014) 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 -- 172.21.15.43:0/2124415774 learned_addr learned my addr 172.21.15.43:0/2124415774 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c4bb9700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c006a750 0x7fe2c0199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2c53ba700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c0108a30 0x7fe2c019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 -- 172.21.15.43:0/2124415774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c0108a30 msgr2=0x7fe2c019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c0108a30 0x7fe2c019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 -- 172.21.15.43:0/2124415774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c006a750 msgr2=0x7fe2c0199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c006a750 0x7fe2c0199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 -- 172.21.15.43:0/2124415774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c019e110 con 0x7fe2c006b0f0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.439+0000 7fe2bffff700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00d950 tx=0x7fe2ac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.440+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac016070 con 0x7fe2c006b0f0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.440+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2ac00fd60 con 0x7fe2c006b0f0 2024-04-25T20:46:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.440+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c019e400 con 0x7fe2c006b0f0 2024-04-25T20:46:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.440+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00e610 con 0x7fe2c006b0f0 2024-04-25T20:46:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.440+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c01a5c80 con 0x7fe2c006b0f0 2024-04-25T20:46:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.441+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c0069730 con 0x7fe2c006b0f0 2024-04-25T20:46:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.442+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fe2ac019070 con 0x7fe2c006b0f0 2024-04-25T20:46:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.442+0000 7fe2bdffb700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 0x7fe2b00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.443+0000 7fe2c4bb9700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 0x7fe2b00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.443+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fe2ac0cfd70 con 0x7fe2c006b0f0 2024-04-25T20:46:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.443+0000 7fe2c4bb9700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 0x7fe2b00a6180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400abd0 tx=0x7fe2b400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:53.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.447+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe2ac09c800 con 0x7fe2c006b0f0 2024-04-25T20:46:53.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.689+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe2c0062e80 con 0x7fe2b00a3cc0 2024-04-25T20:46:53.691 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-mon[29167]: pgmap v313: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-04-25T20:46:53.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.723+0000 7fe2bdffb700 1 -- 172.21.15.43:0/2124415774 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe2c0062e80 con 0x7fe2b00a3cc0 2024-04-25T20:46:53.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 msgr2=0x7fe2b00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:53.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 0x7fe2b00a6180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400abd0 tx=0x7fe2b400a380 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 msgr2=0x7fe2c0199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00d950 tx=0x7fe2ac00dc60 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 shutdown_connections 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe2b00a3cc0 0x7fe2b00a6180 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2c0108a30 0x7fe2c019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2c006a750 0x7fe2c0199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.725+0000 7fe2c6e1d700 1 --2- 172.21.15.43:0/2124415774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2c006b0f0 0x7fe2c0199640 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.726+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 >> 172.21.15.43:0/2124415774 conn(0x7fe2c00788f0 msgr2=0x7fe2c00ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.726+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 shutdown_connections 2024-04-25T20:46:53.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:53.726+0000 7fe2c6e1d700 1 -- 172.21.15.43:0/2124415774 wait complete. 2024-04-25T20:46:53.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:53 smithi195 ceph-mon[33250]: pgmap v313: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-04-25T20:46:53.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:53 smithi112 ceph-mon[32322]: pgmap v313: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-04-25T20:46:54.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:46:53.694+0000 7fa558bb1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:46:54.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:46:53.694+0000 7fa558bb1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:46:54.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:46:53.694+0000 7fa558bb1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:46:54.044 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:46:53.694+0000 7fa558bb1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:46:54.045 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:46:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:46:53.694+0000 7fa558bb1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:46:54.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-25T20:46:54.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:54 smithi043 ceph-mon[29167]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:54.816 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:54.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:54 smithi195 ceph-mon[33250]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:54.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:54 smithi112 ceph-mon[32322]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:55.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:55 smithi043 ceph-mon[29167]: pgmap v314: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-04-25T20:46:55.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:55 smithi195 ceph-mon[33250]: pgmap v314: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-04-25T20:46:55.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:55 smithi112 ceph-mon[32322]: pgmap v314: 97 pgs: 97 active+clean; 584 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.9 KiB/s wr, 19 op/s 2024-04-25T20:46:56.694 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:56 smithi043 ceph-mon[29167]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 -- 172.21.15.43:0/3376478098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec108a20 msgr2=0x7ff7ec108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 --2- 172.21.15.43:0/3376478098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec108a20 0x7ff7ec108e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009990 tx=0x7ff7dc009ca0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 -- 172.21.15.43:0/3376478098 shutdown_connections 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 --2- 172.21.15.43:0/3376478098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec06b980 0x7ff7ec10f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 --2- 172.21.15.43:0/3376478098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec108a20 0x7ff7ec108e00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 --2- 172.21.15.43:0/3376478098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 0x7ff7ec06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 -- 172.21.15.43:0/3376478098 >> 172.21.15.43:0/3376478098 conn(0x7ff7ec0788b0 msgr2=0x7ff7ec078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:56.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 -- 172.21.15.43:0/3376478098 shutdown_connections 2024-04-25T20:46:56.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.700+0000 7ff7f451b700 1 -- 172.21.15.43:0/3376478098 wait complete. 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 Processor -- start 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 -- start start 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 0x7ff7ec199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec108a20 0x7ff7ec19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec112de0 con 0x7ff7ec06b980 2024-04-25T20:46:56.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec112c60 con 0x7ff7ec108a20 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f451b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec112f60 con 0x7ff7ec06afe0 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60646/0 (socket says 172.21.15.43:60646) 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 -- 172.21.15.43:0/1219147420 learned_addr learned my addr 172.21.15.43:0/1219147420 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f22b7700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 0x7ff7ec199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 -- 172.21.15.43:0/1219147420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 msgr2=0x7ff7ec199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 0x7ff7ec199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 -- 172.21.15.43:0/1219147420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec108a20 msgr2=0x7ff7ec19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec108a20 0x7ff7ec19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.701+0000 7ff7f1ab6700 1 -- 172.21.15.43:0/1219147420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec19e320 con 0x7ff7ec06b980 2024-04-25T20:46:56.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7f1ab6700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800b530 tx=0x7ff7e800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8015020 con 0x7ff7ec06b980 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff7e8011d00 con 0x7ff7ec06b980 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec19e610 con 0x7ff7ec06b980 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800f2e0 con 0x7ff7ec06b980 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.702+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1a5e90 con 0x7ff7ec06b980 2024-04-25T20:46:56.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.703+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec069730 con 0x7ff7ec06b980 2024-04-25T20:46:56.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.704+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff7e8018020 con 0x7ff7ec06b980 2024-04-25T20:46:56.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.705+0000 7ff7e37fe700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 0x7ff7d80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:56.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.705+0000 7ff7f22b7700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 0x7ff7d80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:56.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.705+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ff7e80d0110 con 0x7ff7ec06b980 2024-04-25T20:46:56.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.706+0000 7ff7f22b7700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 0x7ff7d80a6210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00b5c0 tx=0x7ff7dc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:56.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.709+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7e801f020 con 0x7ff7ec06b980 2024-04-25T20:46:56.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:56 smithi195 ceph-mon[33250]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T20:46:56.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:56 smithi112 ceph-mon[32322]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-25T20:46:56.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.948+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff7ec062e80 con 0x7ff7d80a3d50 2024-04-25T20:46:56.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.976+0000 7ff7e37fe700 1 -- 172.21.15.43:0/1219147420 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff7ec062e80 con 0x7ff7d80a3d50 2024-04-25T20:46:56.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 msgr2=0x7ff7d80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:56.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 0x7ff7d80a6210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00b5c0 tx=0x7ff7dc005960 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 msgr2=0x7ff7ec199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800b530 tx=0x7ff7e800b840 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 shutdown_connections 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff7d80a3d50 0x7ff7d80a6210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7ec06afe0 0x7ff7ec199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff7ec108a20 0x7ff7ec19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 --2- 172.21.15.43:0/1219147420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7ec06b980 0x7ff7ec199850 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 >> 172.21.15.43:0/1219147420 conn(0x7ff7ec0788b0 msgr2=0x7ff7ec0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 shutdown_connections 2024-04-25T20:46:56.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:56.978+0000 7ff7f451b700 1 -- 172.21.15.43:0/1219147420 wait complete. 2024-04-25T20:46:57.663 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:57 smithi043 ceph-mon[29167]: pgmap v315: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 24 op/s 2024-04-25T20:46:57.663 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:57 smithi043 ceph-mon[29167]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:57.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-25T20:46:57.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:57 smithi195 ceph-mon[33250]: pgmap v315: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 24 op/s 2024-04-25T20:46:57.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:57 smithi195 ceph-mon[33250]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:57.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:57 smithi112 ceph-mon[32322]: pgmap v315: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.0 KiB/s wr, 24 op/s 2024-04-25T20:46:57.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:57 smithi112 ceph-mon[32322]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:46:57.948 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 -- 172.21.15.43:0/2341790184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101ad0 msgr2=0x7f003c1117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 --2- 172.21.15.43:0/2341790184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101ad0 0x7f003c1117c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f003400b0a0 tx=0x7f003400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 -- 172.21.15.43:0/2341790184 shutdown_connections 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 --2- 172.21.15.43:0/2341790184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101ad0 0x7f003c1117c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 --2- 172.21.15.43:0/2341790184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 0x7f003c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 --2- 172.21.15.43:0/2341790184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101030 0x7f003c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 -- 172.21.15.43:0/2341790184 >> 172.21.15.43:0/2341790184 conn(0x7f003c077fb0 msgr2=0x7f003c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 -- 172.21.15.43:0/2341790184 shutdown_connections 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 -- 172.21.15.43:0/2341790184 wait complete. 2024-04-25T20:46:59.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.730+0000 7f0041ef7700 1 Processor -- start 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 -- start start 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101ad0 0x7f003c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 0x7f003c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f003c114fa0 con 0x7f003c101030 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f003c114e20 con 0x7f003c103950 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f0041ef7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f003c115120 con 0x7f003c101ad0 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60672/0 (socket says 172.21.15.43:60672) 2024-04-25T20:46:59.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 -- 172.21.15.43:0/1967120015 learned_addr learned my addr 172.21.15.43:0/1967120015 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003bfff700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 0x7f003c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003affd700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101ad0 0x7f003c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 -- 172.21.15.43:0/1967120015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101ad0 msgr2=0x7f003c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101ad0 0x7f003c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 -- 172.21.15.43:0/1967120015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 msgr2=0x7f003c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 0x7f003c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 -- 172.21.15.43:0/1967120015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c1a0400 con 0x7f003c101030 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.731+0000 7f003b7fe700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f002c00d980 tx=0x7f002c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.732+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c016070 con 0x7f003c101030 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.732+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c1a06f0 con 0x7f003c101030 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.732+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f002c004d00 con 0x7f003c101030 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.732+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c005610 con 0x7f003c101030 2024-04-25T20:46:59.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.732+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1a7f70 con 0x7f003c101030 2024-04-25T20:46:59.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.733+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c102040 con 0x7f003c101030 2024-04-25T20:46:59.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.734+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f002c004750 con 0x7f003c101030 2024-04-25T20:46:59.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.735+0000 7f0038ff9700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 0x7f00240a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:46:59.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.735+0000 7f003affd700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 0x7f00240a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:46:59.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.735+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f002c0d0610 con 0x7f003c101030 2024-04-25T20:46:59.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.735+0000 7f003affd700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 0x7f00240a6190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f003c100550 tx=0x7f0030009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:46:59.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.738+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f002c01f020 con 0x7f003c101030 2024-04-25T20:46:59.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.981+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f003c062e80 con 0x7f00240a3cd0 2024-04-25T20:46:59.983 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:46:59 smithi043 ceph-mon[29167]: pgmap v316: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 17 op/s 2024-04-25T20:46:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.988+0000 7f0038ff9700 1 -- 172.21.15.43:0/1967120015 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f003c062e80 con 0x7f00240a3cd0 2024-04-25T20:46:59.989 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_0/a18facca-6d30-4239-bf32-90ce168b0c64 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 msgr2=0x7f00240a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 0x7f00240a6190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f003c100550 tx=0x7f0030009260 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 msgr2=0x7f003c19b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f002c00d980 tx=0x7f002c00dc90 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 shutdown_connections 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f00240a3cd0 0x7f00240a6190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f003c103950 0x7f003c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f003c101030 0x7f003c19b3f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 --2- 172.21.15.43:0/1967120015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f003c101ad0 0x7f003c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 >> 172.21.15.43:0/1967120015 conn(0x7f003c077fb0 msgr2=0x7f003c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 shutdown_connections 2024-04-25T20:46:59.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:46:59.990+0000 7f0041ef7700 1 -- 172.21.15.43:0/1967120015 wait complete. 2024-04-25T20:47:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:46:59 smithi195 ceph-mon[33250]: pgmap v316: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 17 op/s 2024-04-25T20:47:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:46:59 smithi112 ceph-mon[32322]: pgmap v316: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.9 KiB/s wr, 17 op/s 2024-04-25T20:47:00.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-25T20:47:01.005 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:01.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:00 smithi043 ceph-mon[29167]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:01.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:00 smithi195 ceph-mon[33250]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:01.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:00 smithi112 ceph-mon[32322]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:01 smithi043 ceph-mon[29167]: pgmap v317: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-25T20:47:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:01 smithi195 ceph-mon[33250]: pgmap v317: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-25T20:47:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:01 smithi112 ceph-mon[32322]: pgmap v317: 97 pgs: 97 active+clean; 592 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 -- 172.21.15.43:0/1877869243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac106990 msgr2=0x7f3aac106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 --2- 172.21.15.43:0/1877869243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac106990 0x7f3aac106d70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009990 tx=0x7f3aa4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 -- 172.21.15.43:0/1877869243 shutdown_connections 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 --2- 172.21.15.43:0/1877869243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 0x7f3aac10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 --2- 172.21.15.43:0/1877869243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac106990 0x7f3aac106d70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 --2- 172.21.15.43:0/1877869243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac101d20 0x7f3aac1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 -- 172.21.15.43:0/1877869243 >> 172.21.15.43:0/1877869243 conn(0x7f3aac0788f0 msgr2=0x7f3aac078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 -- 172.21.15.43:0/1877869243 shutdown_connections 2024-04-25T20:47:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.753+0000 7f3ab3821700 1 -- 172.21.15.43:0/1877869243 wait complete. 2024-04-25T20:47:02.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 Processor -- start 2024-04-25T20:47:02.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 -- start start 2024-04-25T20:47:02.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:02.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 0x7f3aac199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:02.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac106990 0x7f3aac19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac111c40 con 0x7f3aac101d20 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac111ac0 con 0x7f3aac106990 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab3821700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac111dc0 con 0x7f3aac1026e0 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab15bd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab15bd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60696/0 (socket says 172.21.15.43:60696) 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab15bd700 1 -- 172.21.15.43:0/2331092644 learned_addr learned my addr 172.21.15.43:0/2331092644 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab0dbc700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 0x7f3aac199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.754+0000 7f3ab1dbe700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac106990 0x7f3aac19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 -- 172.21.15.43:0/2331092644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 msgr2=0x7f3aac199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 0x7f3aac199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 -- 172.21.15.43:0/2331092644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac106990 msgr2=0x7f3aac19d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac106990 0x7f3aac19d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 -- 172.21.15.43:0/2331092644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac19e0d0 con 0x7f3aac101d20 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab15bd700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005f50 tx=0x7f3aa40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4026070 con 0x7f3aac101d20 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aac19e360 con 0x7f3aac101d20 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3aa400fb40 con 0x7f3aac101d20 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40173f0 con 0x7f3aac101d20 2024-04-25T20:47:02.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.755+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aac1a5c40 con 0x7f3aac101d20 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.756+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aac103080 con 0x7f3aac101d20 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.757+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3aa4029070 con 0x7f3aac101d20 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.758+0000 7f3aaa7fc700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 0x7f3a940a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.758+0000 7f3ab0dbc700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 0x7f3a940a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.758+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f3aa40d1130 con 0x7f3aac101d20 2024-04-25T20:47:02.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.758+0000 7f3ab0dbc700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 0x7f3a940a6190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3aac106000 tx=0x7f3aa0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:02.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:02.762+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3aa4013070 con 0x7f3aac101d20 2024-04-25T20:47:03.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.002+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3aac19a420 con 0x7f3a940a3cd0 2024-04-25T20:47:03.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.034+0000 7f3aaa7fc700 1 -- 172.21.15.43:0/2331092644 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3aac19a420 con 0x7f3a940a3cd0 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 msgr2=0x7f3a940a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 0x7f3a940a6190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3aac106000 tx=0x7f3aa0009260 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 msgr2=0x7f3aac1990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005f50 tx=0x7f3aa40057c0 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 shutdown_connections 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f3a940a3cd0 0x7f3a940a6190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3aac106990 0x7f3aac19d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3aac101d20 0x7f3aac1990c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 --2- 172.21.15.43:0/2331092644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3aac1026e0 0x7f3aac199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 >> 172.21.15.43:0/2331092644 conn(0x7f3aac0788f0 msgr2=0x7f3aac101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 shutdown_connections 2024-04-25T20:47:03.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:03.036+0000 7f3ab3821700 1 -- 172.21.15.43:0/2331092644 wait complete. 2024-04-25T20:47:03.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-25T20:47:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:03 smithi043 ceph-mon[29167]: pgmap v318: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-04-25T20:47:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:03 smithi043 ceph-mon[29167]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:03 smithi195 ceph-mon[33250]: pgmap v318: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-04-25T20:47:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:03 smithi195 ceph-mon[33250]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:03 smithi112 ceph-mon[32322]: pgmap v318: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-04-25T20:47:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:03 smithi112 ceph-mon[32322]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-04-25T20:47:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:04 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T20:47:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:04 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T20:47:05.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]: dispatch 2024-04-25T20:47:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:04 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.857+0000 7f72bfb8e700 1 -- 172.21.15.43:0/4113849417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8101940 msgr2=0x7f72b8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.857+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/4113849417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8101940 0x7f72b8101dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009990 tx=0x7f72a8009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 -- 172.21.15.43:0/4113849417 shutdown_connections 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/4113849417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8107990 0x7f72b8107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/4113849417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 0x7f72b810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/4113849417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8101940 0x7f72b8101dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 -- 172.21.15.43:0/4113849417 >> 172.21.15.43:0/4113849417 conn(0x7f72b80788f0 msgr2=0x7f72b8078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 -- 172.21.15.43:0/4113849417 shutdown_connections 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 -- 172.21.15.43:0/4113849417 wait complete. 2024-04-25T20:47:05.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 Processor -- start 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: pgmap v319: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-04-25T20:47:05.861 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T20:47:05.862 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:05 smithi043 ceph-mon[29167]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T20:47:05.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.858+0000 7f72bfb8e700 1 -- start start 2024-04-25T20:47:05.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8101940 0x7f72b819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:05.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 0x7f72b819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8111cc0 con 0x7f72b8107990 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8111b40 con 0x7f72b8102300 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bfb8e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8111e40 con 0x7f72b8101940 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49712/0 (socket says 172.21.15.43:49712) 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 -- 172.21.15.43:0/2468085835 learned_addr learned my addr 172.21.15.43:0/2468085835 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bd129700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 0x7f72b819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72bd92a700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8101940 0x7f72b819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 -- 172.21.15.43:0/2468085835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8101940 msgr2=0x7f72b819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8101940 0x7f72b819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 -- 172.21.15.43:0/2468085835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 msgr2=0x7f72b819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 0x7f72b819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 -- 172.21.15.43:0/2468085835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b81a56a0 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.859+0000 7f72be12b700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72b000ada0 tx=0x7f72b000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.860+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0017020 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.860+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b81a5930 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.860+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72b000cda0 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.860+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005310 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.860+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b81a5df0 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.861+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8109eb0 con 0x7f72b8107990 2024-04-25T20:47:05.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.862+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f72b000c8d0 con 0x7f72b8107990 2024-04-25T20:47:05.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.863+0000 7f72aeffd700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 0x7f72a40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:05.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.863+0000 7f72bd92a700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 0x7f72a40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:05.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.863+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f72b00cfcf0 con 0x7f72b8107990 2024-04-25T20:47:05.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.863+0000 7f72bd92a700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 0x7f72a40a6190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72b40045b0 tx=0x7f72b400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:05.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:05.867+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f72b0021020 con 0x7f72b8107990 2024-04-25T20:47:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: pgmap v319: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:05 smithi195 ceph-mon[33250]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T20:47:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: pgmap v319: 97 pgs: 97 active+clean; 611 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 8]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 6]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-04-25T20:47:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:05 smithi112 ceph-mon[32322]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T20:47:06.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.111+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f72b8062e80 con 0x7f72a40a3cd0 2024-04-25T20:47:06.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.117+0000 7f72aeffd700 1 -- 172.21.15.43:0/2468085835 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f72b8062e80 con 0x7f72a40a3cd0 2024-04-25T20:47:06.118 INFO:teuthology.orchestra.run.smithi043.stdout:/volumes/qa/sv_1/a8ff5fa1-73ab-4768-a331-eb33910e945c 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 msgr2=0x7f72a40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 0x7f72a40a6190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f72b40045b0 tx=0x7f72b400b3c0 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 msgr2=0x7f72b81a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72b000ada0 tx=0x7f72b000c330 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 shutdown_connections 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f72a40a3cd0 0x7f72a40a6190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b8101940 0x7f72b819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b8107990 0x7f72b81a5160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 --2- 172.21.15.43:0/2468085835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72b8102300 0x7f72b819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 >> 172.21.15.43:0/2468085835 conn(0x7f72b80788f0 msgr2=0x7f72b8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:06.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 shutdown_connections 2024-04-25T20:47:06.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:06.119+0000 7f72bfb8e700 1 -- 172.21.15.43:0/2468085835 wait complete. 2024-04-25T20:47:06.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:47:07.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:06 smithi043 ceph-mon[29167]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T20:47:07.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:06 smithi043 ceph-mon[29167]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:07.076 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:07.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:06 smithi195 ceph-mon[33250]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T20:47:07.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:06 smithi195 ceph-mon[33250]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:07.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:06 smithi112 ceph-mon[32322]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T20:47:07.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:06 smithi112 ceph-mon[32322]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:47:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:07 smithi043 ceph-mon[29167]: pgmap v322: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-04-25T20:47:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:07 smithi195 ceph-mon[33250]: pgmap v322: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-04-25T20:47:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:07 smithi112 ceph-mon[32322]: pgmap v322: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-04-25T20:47:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 -- 172.21.15.43:0/551656782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0102af0 msgr2=0x7f4ba0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 --2- 172.21.15.43:0/551656782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0102af0 0x7f4ba0102f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009990 tx=0x7f4b90009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 -- 172.21.15.43:0/551656782 shutdown_connections 2024-04-25T20:47:08.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 --2- 172.21.15.43:0/551656782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0108a80 0x7f4ba0108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 --2- 172.21.15.43:0/551656782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 --2- 172.21.15.43:0/551656782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0102af0 0x7f4ba0102f70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 -- 172.21.15.43:0/551656782 >> 172.21.15.43:0/551656782 conn(0x7f4ba0079b20 msgr2=0x7f4ba0079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 -- 172.21.15.43:0/551656782 shutdown_connections 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.765+0000 7f4ba7850700 1 -- 172.21.15.43:0/551656782 wait complete. 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 Processor -- start 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 -- start start 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 0x7f4ba01992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba0199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112e50 con 0x7f4ba0108a80 2024-04-25T20:47:08.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112cd0 con 0x7f4ba01034b0 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba7850700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112fd0 con 0x7f4ba0102af0 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba5ded700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba5ded700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49722/0 (socket says 172.21.15.43:49722) 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba5ded700 1 -- 172.21.15.43:0/1463115016 learned_addr learned my addr 172.21.15.43:0/1463115016 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.766+0000 7f4ba55ec700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 0x7f4ba01992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba4deb700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba0199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 -- 172.21.15.43:0/1463115016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 msgr2=0x7f4ba01992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 0x7f4ba01992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 -- 172.21.15.43:0/1463115016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 msgr2=0x7f4ba0199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba0199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 -- 172.21.15.43:0/1463115016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba019e2f0 con 0x7f4ba0108a80 2024-04-25T20:47:08.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba55ec700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 0x7f4ba01992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba4deb700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba0199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba5ded700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800b970 tx=0x7f4b9800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98019070 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b98014440 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba019e5e0 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980075d0 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.767+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba01a5e60 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.768+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba0069730 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.769+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4b9801c070 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.770+0000 7f4b967fc700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 0x7f4b8c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.770+0000 7f4ba55ec700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 0x7f4b8c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.770+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f4b980cf900 con 0x7f4ba0108a80 2024-04-25T20:47:08.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.770+0000 7f4ba55ec700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 0x7f4b8c0a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0099d0 tx=0x7f4b9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:08.775+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b9809c240 con 0x7f4ba0108a80 2024-04-25T20:47:09.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.029+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba019a640 con 0x7f4ba0108a80 2024-04-25T20:47:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.030+0000 7f4b967fc700 1 -- 172.21.15.43:0/1463115016 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7f4b9809bb40 con 0x7f4ba0108a80 2024-04-25T20:47:09.032 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:09.032 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 msgr2=0x7f4b8c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 0x7f4b8c0a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0099d0 tx=0x7f4b9c008040 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 msgr2=0x7f4ba019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800b970 tx=0x7f4b9800bd30 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 shutdown_connections 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b8c0a3cd0 0x7f4b8c0a6190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ba0102af0 0x7f4ba01992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ba0108a80 0x7f4ba019dbb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 --2- 172.21.15.43:0/1463115016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ba01034b0 0x7f4ba0199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 >> 172.21.15.43:0/1463115016 conn(0x7f4ba0079b20 msgr2=0x7f4ba0101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 shutdown_connections 2024-04-25T20:47:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:09.033+0000 7f4ba7850700 1 -- 172.21.15.43:0/1463115016 wait complete. 2024-04-25T20:47:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:47:09.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:47:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:09 smithi043 ceph-mon[29167]: pgmap v323: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1463115016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:47:10.054 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:09 smithi195 ceph-mon[33250]: pgmap v323: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1463115016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:47:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:09 smithi112 ceph-mon[32322]: pgmap v323: 97 pgs: 1 peering, 96 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1463115016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:47:11.770 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:11 smithi043 ceph-mon[29167]: pgmap v324: 97 pgs: 97 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 -- 172.21.15.43:0/4172180423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44108a70 msgr2=0x7f9e44108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/4172180423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44108a70 0x7f9e44108e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009990 tx=0x7f9e34009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 -- 172.21.15.43:0/4172180423 shutdown_connections 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/4172180423 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44103480 0x7f9e4410f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/4172180423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44108a70 0x7f9e44108e50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/4172180423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44102ac0 0x7f9e44102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 -- 172.21.15.43:0/4172180423 >> 172.21.15.43:0/4172180423 conn(0x7f9e44079bb0 msgr2=0x7f9e44079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 -- 172.21.15.43:0/4172180423 shutdown_connections 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.767+0000 7f9e4a82c700 1 -- 172.21.15.43:0/4172180423 wait complete. 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.768+0000 7f9e4a82c700 1 Processor -- start 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.768+0000 7f9e4a82c700 1 -- start start 2024-04-25T20:47:11.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44103480 0x7f9e44199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 0x7f9e4419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44112e10 con 0x7f9e44102ac0 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44112c90 con 0x7f9e44108a70 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44112f90 con 0x7f9e44103480 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49740/0 (socket says 172.21.15.43:49740) 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 -- 172.21.15.43:0/950573312 learned_addr learned my addr 172.21.15.43:0/950573312 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e437fe700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44103480 0x7f9e44199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e48dc9700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 0x7f9e4419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 -- 172.21.15.43:0/950573312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44103480 msgr2=0x7f9e44199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44103480 0x7f9e44199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 -- 172.21.15.43:0/950573312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 msgr2=0x7f9e4419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 0x7f9e4419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 -- 172.21.15.43:0/950573312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4419e330 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e48dc9700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 0x7f9e4419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e43fff700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e340047b0 tx=0x7f9e34005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34027070 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e34003780 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4419e5c0 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.769+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34022ca0 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.770+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441a5ea0 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.770+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e44069730 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.772+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9e3402a070 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.773+0000 7f9e417fa700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 0x7f9e2c0a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.773+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f9e340d13f0 con 0x7f9e44102ac0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.773+0000 7f9e437fe700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 0x7f9e2c0a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:11.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.773+0000 7f9e437fe700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 0x7f9e2c0a6290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e4407a270 tx=0x7f9e3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:11.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.777+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9e3405eff0 con 0x7f9e44102ac0 2024-04-25T20:47:11.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.985+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e4402df80 con 0x7f9e44102ac0 2024-04-25T20:47:11.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.986+0000 7f9e417fa700 1 -- 172.21.15.43:0/950573312 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22627 (secure 0 0 0) 0x7f9e34013070 con 0x7f9e44102ac0 2024-04-25T20:47:11.988 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:11.993 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":91,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:47:05.741996+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:47:11.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.988+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 msgr2=0x7f9e2c0a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:11.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.988+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 0x7f9e2c0a6290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e4407a270 tx=0x7f9e3800b410 comp rx=0 tx=0).stop 2024-04-25T20:47:11.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.988+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 msgr2=0x7f9e44199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.988+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e340047b0 tx=0x7f9e34005e80 comp rx=0 tx=0).stop 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.988+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 shutdown_connections 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9e2c0a3dd0 0x7f9e2c0a6290 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9e44108a70 0x7f9e4419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e44102ac0 0x7f9e44199320 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 --2- 172.21.15.43:0/950573312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e44103480 0x7f9e44199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 >> 172.21.15.43:0/950573312 conn(0x7f9e44079bb0 msgr2=0x7f9e44101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:11.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 shutdown_connections 2024-04-25T20:47:11.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:11.989+0000 7f9e4a82c700 1 -- 172.21.15.43:0/950573312 wait complete. 2024-04-25T20:47:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:11 smithi195 ceph-mon[33250]: pgmap v324: 97 pgs: 97 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:11 smithi112 ceph-mon[32322]: pgmap v324: 97 pgs: 97 active+clean; 629 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:12.724 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T20:47:12.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:47:12.977 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:12 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/950573312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:12 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/950573312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:12 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/950573312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:13 smithi043 ceph-mon[29167]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:13 smithi195 ceph-mon[33250]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:13 smithi112 ceph-mon[32322]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:14.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- 172.21.15.43:0/658041537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c102a90 msgr2=0x7efc1c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 --2- 172.21.15.43:0/658041537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c102a90 0x7efc1c102f10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009990 tx=0x7efc0c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- 172.21.15.43:0/658041537 shutdown_connections 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 --2- 172.21.15.43:0/658041537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c108a50 0x7efc1c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 --2- 172.21.15.43:0/658041537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 --2- 172.21.15.43:0/658041537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c102a90 0x7efc1c102f10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- 172.21.15.43:0/658041537 >> 172.21.15.43:0/658041537 conn(0x7efc1c079ba0 msgr2=0x7efc1c079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- 172.21.15.43:0/658041537 shutdown_connections 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- 172.21.15.43:0/658041537 wait complete. 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 Processor -- start 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.729+0000 7efc2402f700 1 -- start start 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c102a90 0x7efc1c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:14.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c112d40 con 0x7efc1c108a50 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c112bc0 con 0x7efc1c103450 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc2402f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efc1c112ec0 con 0x7efc1c102a90 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49762/0 (socket says 172.21.15.43:49762) 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 -- 172.21.15.43:0/2204492160 learned_addr learned my addr 172.21.15.43:0/2204492160 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:14.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc215ca700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 -- 172.21.15.43:0/2204492160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c102a90 msgr2=0x7efc1c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c102a90 0x7efc1c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 -- 172.21.15.43:0/2204492160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 msgr2=0x7efc1c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 -- 172.21.15.43:0/2204492160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1c19e1b0 con 0x7efc1c108a50 2024-04-25T20:47:14.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc215ca700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.730+0000 7efc225cc700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc14007ee0 tx=0x7efc1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.731+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1400dbd0 con 0x7efc1c108a50 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.731+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc1400dd70 con 0x7efc1c108a50 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.731+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1c19e4a0 con 0x7efc1c108a50 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.731+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc140133f0 con 0x7efc1c108a50 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.731+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1c1a5d20 con 0x7efc1c108a50 2024-04-25T20:47:14.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.732+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1c069730 con 0x7efc1c108a50 2024-04-25T20:47:14.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.733+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7efc1401a020 con 0x7efc1c108a50 2024-04-25T20:47:14.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.734+0000 7efc12ffd700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 0x7efc080a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:14.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.734+0000 7efc21dcb700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 0x7efc080a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:14.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.734+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7efc140cfe30 con 0x7efc1c108a50 2024-04-25T20:47:14.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.734+0000 7efc21dcb700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 0x7efc080a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc1800a9b0 tx=0x7efc18005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:14.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.738+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efc14010070 con 0x7efc1c108a50 2024-04-25T20:47:14.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.946+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc1c062e80 con 0x7efc080a3d50 2024-04-25T20:47:14.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.954+0000 7efc12ffd700 1 -- 172.21.15.43:0/2204492160 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258988 (secure 0 0 0) 0x7efc1c062e80 con 0x7efc080a3d50 2024-04-25T20:47:14.959 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 msgr2=0x7efc080a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 0x7efc080a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc1800a9b0 tx=0x7efc18005c90 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 msgr2=0x7efc1c19da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc14007ee0 tx=0x7efc1400d3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 shutdown_connections 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7efc080a3d50 0x7efc080a6210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc1c102a90 0x7efc1c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc1c108a50 0x7efc1c19da70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 --2- 172.21.15.43:0/2204492160 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efc1c103450 0x7efc1c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 >> 172.21.15.43:0/2204492160 conn(0x7efc1c079ba0 msgr2=0x7efc1c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 shutdown_connections 2024-04-25T20:47:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:14.957+0000 7efc2402f700 1 -- 172.21.15.43:0/2204492160 wait complete. 2024-04-25T20:47:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:47:15.664 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-04-25T20:47:14.676810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652955,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":425,"num_read_kb":333,"num_write":422,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390544,"kb_used_data":12216,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551280,"statfs":{"total":1151940427776,"available":1151540510720,"internally_reserved":0,"allocated":12509184,"data_stored":7747161,"data_compressed":113820,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27539,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":101,"num_read_kb":76,"num_write":18,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.934337"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753171+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:47:05.753171+0000","last_peered":"2024-04-25T20:47:05.753171+0000","last_clean":"2024-04-25T20:47:05.753171+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:47:05.753171+0000","last_undegraded":"2024-04-25T20:47:05.753171+0000","last_fullsized":"2024-04-25T20:47:05.753171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753969+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:47:05.753969+0000","last_peered":"2024-04-25T20:47:05.753969+0000","last_clean":"2024-04-25T20:47:05.753969+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:47:05.753969+0000","last_undegraded":"2024-04-25T20:47:05.753969+0000","last_fullsized":"2024-04-25T20:47:05.753969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754116+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:47:05.754116+0000","last_peered":"2024-04-25T20:47:05.754116+0000","last_clean":"2024-04-25T20:47:05.754116+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:47:05.754116+0000","last_undegraded":"2024-04-25T20:47:05.754116+0000","last_fullsized":"2024-04-25T20:47:05.754116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.919019+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:47:05.919019+0000","last_peered":"2024-04-25T20:47:05.919019+0000","last_clean":"2024-04-25T20:47:05.919019+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:47:05.919019+0000","last_undegraded":"2024-04-25T20:47:05.919019+0000","last_fullsized":"2024-04-25T20:47:05.919019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756158+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:47:05.756158+0000","last_peered":"2024-04-25T20:47:05.756158+0000","last_clean":"2024-04-25T20:47:05.756158+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:47:05.756158+0000","last_undegraded":"2024-04-25T20:47:05.756158+0000","last_fullsized":"2024-04-25T20:47:05.756158+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.757617+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:47:05.757617+0000","last_peered":"2024-04-25T20:47:05.757617+0000","last_clean":"2024-04-25T20:47:05.757617+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:47:05.757617+0000","last_undegraded":"2024-04-25T20:47:05.757617+0000","last_fullsized":"2024-04-25T20:47:05.757617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754188+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:47:05.754188+0000","last_peered":"2024-04-25T20:47:05.754188+0000","last_clean":"2024-04-25T20:47:05.754188+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:47:05.754188+0000","last_undegraded":"2024-04-25T20:47:05.754188+0000","last_fullsized":"2024-04-25T20:47:05.754188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137789+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:47:06.137789+0000","last_peered":"2024-04-25T20:47:06.137789+0000","last_clean":"2024-04-25T20:47:06.137789+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:47:06.137789+0000","last_undegraded":"2024-04-25T20:47:06.137789+0000","last_fullsized":"2024-04-25T20:47:06.137789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750560+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:47:05.750560+0000","last_peered":"2024-04-25T20:47:05.750560+0000","last_clean":"2024-04-25T20:47:05.750560+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:47:05.750560+0000","last_undegraded":"2024-04-25T20:47:05.750560+0000","last_fullsized":"2024-04-25T20:47:05.750560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752879+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:47:05.752879+0000","last_peered":"2024-04-25T20:47:05.752879+0000","last_clean":"2024-04-25T20:47:05.752879+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:47:05.752879+0000","last_undegraded":"2024-04-25T20:47:05.752879+0000","last_fullsized":"2024-04-25T20:47:05.752879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754735+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:47:05.754735+0000","last_peered":"2024-04-25T20:47:05.754735+0000","last_clean":"2024-04-25T20:47:05.754735+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:47:05.754735+0000","last_undegraded":"2024-04-25T20:47:05.754735+0000","last_fullsized":"2024-04-25T20:47:05.754735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918857+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:47:05.918857+0000","last_peered":"2024-04-25T20:47:05.918857+0000","last_clean":"2024-04-25T20:47:05.918857+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:47:05.918857+0000","last_undegraded":"2024-04-25T20:47:05.918857+0000","last_fullsized":"2024-04-25T20:47:05.918857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751424+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:47:05.751424+0000","last_peered":"2024-04-25T20:47:05.751424+0000","last_clean":"2024-04-25T20:47:05.751424+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:47:05.751424+0000","last_undegraded":"2024-04-25T20:47:05.751424+0000","last_fullsized":"2024-04-25T20:47:05.751424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753402+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:47:05.753402+0000","last_peered":"2024-04-25T20:47:05.753402+0000","last_clean":"2024-04-25T20:47:05.753402+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:47:05.753402+0000","last_undegraded":"2024-04-25T20:47:05.753402+0000","last_fullsized":"2024-04-25T20:47:05.753402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753232+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:47:05.753232+0000","last_peered":"2024-04-25T20:47:05.753232+0000","last_clean":"2024-04-25T20:47:05.753232+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:47:05.753232+0000","last_undegraded":"2024-04-25T20:47:05.753232+0000","last_fullsized":"2024-04-25T20:47:05.753232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749984+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:47:05.749984+0000","last_peered":"2024-04-25T20:47:05.749984+0000","last_clean":"2024-04-25T20:47:05.749984+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:47:05.749984+0000","last_undegraded":"2024-04-25T20:47:05.749984+0000","last_fullsized":"2024-04-25T20:47:05.749984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753319+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:47:05.753319+0000","last_peered":"2024-04-25T20:47:05.753319+0000","last_clean":"2024-04-25T20:47:05.753319+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:47:05.753319+0000","last_undegraded":"2024-04-25T20:47:05.753319+0000","last_fullsized":"2024-04-25T20:47:05.753319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750440+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:47:05.750440+0000","last_peered":"2024-04-25T20:47:05.750440+0000","last_clean":"2024-04-25T20:47:05.750440+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:47:05.750440+0000","last_undegraded":"2024-04-25T20:47:05.750440+0000","last_fullsized":"2024-04-25T20:47:05.750440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:08.534941+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:47:08.534941+0000","last_peered":"2024-04-25T20:47:08.534941+0000","last_clean":"2024-04-25T20:47:08.534941+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:47:08.534941+0000","last_undegraded":"2024-04-25T20:47:08.534941+0000","last_fullsized":"2024-04-25T20:47:08.534941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137985+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:47:06.137985+0000","last_peered":"2024-04-25T20:47:06.137985+0000","last_clean":"2024-04-25T20:47:06.137985+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:47:06.137985+0000","last_undegraded":"2024-04-25T20:47:06.137985+0000","last_fullsized":"2024-04-25T20:47:06.137985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138170+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:47:06.138170+0000","last_peered":"2024-04-25T20:47:06.138170+0000","last_clean":"2024-04-25T20:47:06.138170+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:47:06.138170+0000","last_undegraded":"2024-04-25T20:47:06.138170+0000","last_fullsized":"2024-04-25T20:47:06.138170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754469+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:47:05.754469+0000","last_peered":"2024-04-25T20:47:05.754469+0000","last_clean":"2024-04-25T20:47:05.754469+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:47:05.754469+0000","last_undegraded":"2024-04-25T20:47:05.754469+0000","last_fullsized":"2024-04-25T20:47:05.754469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756813+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:47:05.756813+0000","last_peered":"2024-04-25T20:47:05.756813+0000","last_clean":"2024-04-25T20:47:05.756813+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:47:05.756813+0000","last_undegraded":"2024-04-25T20:47:05.756813+0000","last_fullsized":"2024-04-25T20:47:05.756813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750745+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:47:05.750745+0000","last_peered":"2024-04-25T20:47:05.750745+0000","last_clean":"2024-04-25T20:47:05.750745+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:47:05.750745+0000","last_undegraded":"2024-04-25T20:47:05.750745+0000","last_fullsized":"2024-04-25T20:47:05.750745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756533+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:47:05.756533+0000","last_peered":"2024-04-25T20:47:05.756533+0000","last_clean":"2024-04-25T20:47:05.756533+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:47:05.756533+0000","last_undegraded":"2024-04-25T20:47:05.756533+0000","last_fullsized":"2024-04-25T20:47:05.756533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754423+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:47:05.754423+0000","last_peered":"2024-04-25T20:47:05.754423+0000","last_clean":"2024-04-25T20:47:05.754423+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:47:05.754423+0000","last_undegraded":"2024-04-25T20:47:05.754423+0000","last_fullsized":"2024-04-25T20:47:05.754423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:09.537628+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:47:09.537628+0000","last_peered":"2024-04-25T20:47:09.537628+0000","last_clean":"2024-04-25T20:47:09.537628+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:47:09.537628+0000","last_undegraded":"2024-04-25T20:47:09.537628+0000","last_fullsized":"2024-04-25T20:47:09.537628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755999+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:47:05.755999+0000","last_peered":"2024-04-25T20:47:05.755999+0000","last_clean":"2024-04-25T20:47:05.755999+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:47:05.755999+0000","last_undegraded":"2024-04-25T20:47:05.755999+0000","last_fullsized":"2024-04-25T20:47:05.755999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752327+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:47:05.752327+0000","last_peered":"2024-04-25T20:47:05.752327+0000","last_clean":"2024-04-25T20:47:05.752327+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:47:05.752327+0000","last_undegraded":"2024-04-25T20:47:05.752327+0000","last_fullsized":"2024-04-25T20:47:05.752327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920027+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:47:05.920027+0000","last_peered":"2024-04-25T20:47:05.920027+0000","last_clean":"2024-04-25T20:47:05.920027+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:47:05.920027+0000","last_undegraded":"2024-04-25T20:47:05.920027+0000","last_fullsized":"2024-04-25T20:47:05.920027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751613+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:47:05.751613+0000","last_peered":"2024-04-25T20:47:05.751613+0000","last_clean":"2024-04-25T20:47:05.751613+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:47:05.751613+0000","last_undegraded":"2024-04-25T20:47:05.751613+0000","last_fullsized":"2024-04-25T20:47:05.751613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137900+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:47:06.137900+0000","last_peered":"2024-04-25T20:47:06.137900+0000","last_clean":"2024-04-25T20:47:06.137900+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:47:06.137900+0000","last_undegraded":"2024-04-25T20:47:06.137900+0000","last_fullsized":"2024-04-25T20:47:06.137900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754009+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:47:05.754009+0000","last_peered":"2024-04-25T20:47:05.754009+0000","last_clean":"2024-04-25T20:47:05.754009+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:47:05.754009+0000","last_undegraded":"2024-04-25T20:47:05.754009+0000","last_fullsized":"2024-04-25T20:47:05.754009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749633+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:47:05.749633+0000","last_peered":"2024-04-25T20:47:05.749633+0000","last_clean":"2024-04-25T20:47:05.749633+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:47:05.749633+0000","last_undegraded":"2024-04-25T20:47:05.749633+0000","last_fullsized":"2024-04-25T20:47:05.749633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:10.538412+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:47:10.538412+0000","last_peered":"2024-04-25T20:47:10.538412+0000","last_clean":"2024-04-25T20:47:10.538412+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:47:10.538412+0000","last_undegraded":"2024-04-25T20:47:10.538412+0000","last_fullsized":"2024-04-25T20:47:10.538412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750667+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:47:05.750667+0000","last_peered":"2024-04-25T20:47:05.750667+0000","last_clean":"2024-04-25T20:47:05.750667+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:47:05.750667+0000","last_undegraded":"2024-04-25T20:47:05.750667+0000","last_fullsized":"2024-04-25T20:47:05.750667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754768+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:47:05.754768+0000","last_peered":"2024-04-25T20:47:05.754768+0000","last_clean":"2024-04-25T20:47:05.754768+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:47:05.754768+0000","last_undegraded":"2024-04-25T20:47:05.754768+0000","last_fullsized":"2024-04-25T20:47:05.754768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754394+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:47:05.754394+0000","last_peered":"2024-04-25T20:47:05.754394+0000","last_clean":"2024-04-25T20:47:05.754394+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:47:05.754394+0000","last_undegraded":"2024-04-25T20:47:05.754394+0000","last_fullsized":"2024-04-25T20:47:05.754394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754546+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:47:05.754546+0000","last_peered":"2024-04-25T20:47:05.754546+0000","last_clean":"2024-04-25T20:47:05.754546+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:47:05.754546+0000","last_undegraded":"2024-04-25T20:47:05.754546+0000","last_fullsized":"2024-04-25T20:47:05.754546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750258+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:47:05.750258+0000","last_peered":"2024-04-25T20:47:05.750258+0000","last_clean":"2024-04-25T20:47:05.750258+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:47:05.750258+0000","last_undegraded":"2024-04-25T20:47:05.750258+0000","last_fullsized":"2024-04-25T20:47:05.750258+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'27","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:10.538577+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:47:10.538577+0000","last_peered":"2024-04-25T20:47:10.538577+0000","last_clean":"2024-04-25T20:47:10.538577+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:47:10.538577+0000","last_undegraded":"2024-04-25T20:47:10.538577+0000","last_fullsized":"2024-04-25T20:47:10.538577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":81,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756435+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:47:05.756435+0000","last_peered":"2024-04-25T20:47:05.756435+0000","last_clean":"2024-04-25T20:47:05.756435+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:47:05.756435+0000","last_undegraded":"2024-04-25T20:47:05.756435+0000","last_fullsized":"2024-04-25T20:47:05.756435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750404+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:47:05.750404+0000","last_peered":"2024-04-25T20:47:05.750404+0000","last_clean":"2024-04-25T20:47:05.750404+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:47:05.750404+0000","last_undegraded":"2024-04-25T20:47:05.750404+0000","last_fullsized":"2024-04-25T20:47:05.750404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751149+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:47:05.751149+0000","last_peered":"2024-04-25T20:47:05.751149+0000","last_clean":"2024-04-25T20:47:05.751149+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:47:05.751149+0000","last_undegraded":"2024-04-25T20:47:05.751149+0000","last_fullsized":"2024-04-25T20:47:05.751149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753879+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:47:05.753879+0000","last_peered":"2024-04-25T20:47:05.753879+0000","last_clean":"2024-04-25T20:47:05.753879+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:47:05.753879+0000","last_undegraded":"2024-04-25T20:47:05.753879+0000","last_fullsized":"2024-04-25T20:47:05.753879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754629+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:47:05.754629+0000","last_peered":"2024-04-25T20:47:05.754629+0000","last_clean":"2024-04-25T20:47:05.754629+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:47:05.754629+0000","last_undegraded":"2024-04-25T20:47:05.754629+0000","last_fullsized":"2024-04-25T20:47:05.754629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:08.536302+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:47:08.536302+0000","last_peered":"2024-04-25T20:47:08.536302+0000","last_clean":"2024-04-25T20:47:08.536302+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:47:08.536302+0000","last_undegraded":"2024-04-25T20:47:08.536302+0000","last_fullsized":"2024-04-25T20:47:08.536302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754123+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:47:05.754123+0000","last_peered":"2024-04-25T20:47:05.754123+0000","last_clean":"2024-04-25T20:47:05.754123+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:47:05.754123+0000","last_undegraded":"2024-04-25T20:47:05.754123+0000","last_fullsized":"2024-04-25T20:47:05.754123+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755855+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:47:05.755855+0000","last_peered":"2024-04-25T20:47:05.755855+0000","last_clean":"2024-04-25T20:47:05.755855+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:47:05.755855+0000","last_undegraded":"2024-04-25T20:47:05.755855+0000","last_fullsized":"2024-04-25T20:47:05.755855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753858+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:47:05.753858+0000","last_peered":"2024-04-25T20:47:05.753858+0000","last_clean":"2024-04-25T20:47:05.753858+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:47:05.753858+0000","last_undegraded":"2024-04-25T20:47:05.753858+0000","last_fullsized":"2024-04-25T20:47:05.753858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756828+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:47:05.756828+0000","last_peered":"2024-04-25T20:47:05.756828+0000","last_clean":"2024-04-25T20:47:05.756828+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:47:05.756828+0000","last_undegraded":"2024-04-25T20:47:05.756828+0000","last_fullsized":"2024-04-25T20:47:05.756828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753110+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:47:05.753110+0000","last_peered":"2024-04-25T20:47:05.753110+0000","last_clean":"2024-04-25T20:47:05.753110+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:47:05.753110+0000","last_undegraded":"2024-04-25T20:47:05.753110+0000","last_fullsized":"2024-04-25T20:47:05.753110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750002+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:47:05.750002+0000","last_peered":"2024-04-25T20:47:05.750002+0000","last_clean":"2024-04-25T20:47:05.750002+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:47:05.750002+0000","last_undegraded":"2024-04-25T20:47:05.750002+0000","last_fullsized":"2024-04-25T20:47:05.750002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752528+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:47:05.752528+0000","last_peered":"2024-04-25T20:47:05.752528+0000","last_clean":"2024-04-25T20:47:05.752528+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:47:05.752528+0000","last_undegraded":"2024-04-25T20:47:05.752528+0000","last_fullsized":"2024-04-25T20:47:05.752528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'6","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:10.538405+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:47:10.538405+0000","last_peered":"2024-04-25T20:47:10.538405+0000","last_clean":"2024-04-25T20:47:10.538405+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:47:10.538405+0000","last_undegraded":"2024-04-25T20:47:10.538405+0000","last_fullsized":"2024-04-25T20:47:10.538405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755662+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:47:05.755662+0000","last_peered":"2024-04-25T20:47:05.755662+0000","last_clean":"2024-04-25T20:47:05.755662+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:47:05.755662+0000","last_undegraded":"2024-04-25T20:47:05.755662+0000","last_fullsized":"2024-04-25T20:47:05.755662+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920287+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:47:05.920287+0000","last_peered":"2024-04-25T20:47:05.920287+0000","last_clean":"2024-04-25T20:47:05.920287+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:47:05.920287+0000","last_undegraded":"2024-04-25T20:47:05.920287+0000","last_fullsized":"2024-04-25T20:47:05.920287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:11.552432+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:47:11.552432+0000","last_peered":"2024-04-25T20:47:11.552432+0000","last_clean":"2024-04-25T20:47:11.552432+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:47:11.552432+0000","last_undegraded":"2024-04-25T20:47:11.552432+0000","last_fullsized":"2024-04-25T20:47:11.552432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137869+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:47:06.137869+0000","last_peered":"2024-04-25T20:47:06.137869+0000","last_clean":"2024-04-25T20:47:06.137869+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:47:06.137869+0000","last_undegraded":"2024-04-25T20:47:06.137869+0000","last_fullsized":"2024-04-25T20:47:06.137869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918830+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:47:05.918830+0000","last_peered":"2024-04-25T20:47:05.918830+0000","last_clean":"2024-04-25T20:47:05.918830+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:47:05.918830+0000","last_undegraded":"2024-04-25T20:47:05.918830+0000","last_fullsized":"2024-04-25T20:47:05.918830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754264+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:47:05.754264+0000","last_peered":"2024-04-25T20:47:05.754264+0000","last_clean":"2024-04-25T20:47:05.754264+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:47:05.754264+0000","last_undegraded":"2024-04-25T20:47:05.754264+0000","last_fullsized":"2024-04-25T20:47:05.754264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754986+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:47:05.754986+0000","last_peered":"2024-04-25T20:47:05.754986+0000","last_clean":"2024-04-25T20:47:05.754986+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:47:05.754986+0000","last_undegraded":"2024-04-25T20:47:05.754986+0000","last_fullsized":"2024-04-25T20:47:05.754986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754377+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:47:05.754377+0000","last_peered":"2024-04-25T20:47:05.754377+0000","last_clean":"2024-04-25T20:47:05.754377+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:47:05.754377+0000","last_undegraded":"2024-04-25T20:47:05.754377+0000","last_fullsized":"2024-04-25T20:47:05.754377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756624+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:47:05.756624+0000","last_peered":"2024-04-25T20:47:05.756624+0000","last_clean":"2024-04-25T20:47:05.756624+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:47:05.756624+0000","last_undegraded":"2024-04-25T20:47:05.756624+0000","last_fullsized":"2024-04-25T20:47:05.756624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751445+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:47:05.751445+0000","last_peered":"2024-04-25T20:47:05.751445+0000","last_clean":"2024-04-25T20:47:05.751445+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:47:05.751445+0000","last_undegraded":"2024-04-25T20:47:05.751445+0000","last_fullsized":"2024-04-25T20:47:05.751445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:07.497795+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:47:07.497795+0000","last_peered":"2024-04-25T20:47:07.497795+0000","last_clean":"2024-04-25T20:47:07.497795+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:47:07.497795+0000","last_undegraded":"2024-04-25T20:47:07.497795+0000","last_fullsized":"2024-04-25T20:47:07.497795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138035+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:47:06.138035+0000","last_peered":"2024-04-25T20:47:06.138035+0000","last_clean":"2024-04-25T20:47:06.138035+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:47:06.138035+0000","last_undegraded":"2024-04-25T20:47:06.138035+0000","last_fullsized":"2024-04-25T20:47:06.138035+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918866+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:47:05.918866+0000","last_peered":"2024-04-25T20:47:05.918866+0000","last_clean":"2024-04-25T20:47:05.918866+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:47:05.918866+0000","last_undegraded":"2024-04-25T20:47:05.918866+0000","last_fullsized":"2024-04-25T20:47:05.918866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754209+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:47:05.754209+0000","last_peered":"2024-04-25T20:47:05.754209+0000","last_clean":"2024-04-25T20:47:05.754209+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:47:05.754209+0000","last_undegraded":"2024-04-25T20:47:05.754209+0000","last_fullsized":"2024-04-25T20:47:05.754209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.758571+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:47:05.758571+0000","last_peered":"2024-04-25T20:47:05.758571+0000","last_clean":"2024-04-25T20:47:05.758571+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:47:05.758571+0000","last_undegraded":"2024-04-25T20:47:05.758571+0000","last_fullsized":"2024-04-25T20:47:05.758571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755850+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:47:05.755850+0000","last_peered":"2024-04-25T20:47:05.755850+0000","last_clean":"2024-04-25T20:47:05.755850+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:47:05.755850+0000","last_undegraded":"2024-04-25T20:47:05.755850+0000","last_fullsized":"2024-04-25T20:47:05.755850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137669+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:47:06.137669+0000","last_peered":"2024-04-25T20:47:06.137669+0000","last_clean":"2024-04-25T20:47:06.137669+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:47:06.137669+0000","last_undegraded":"2024-04-25T20:47:06.137669+0000","last_fullsized":"2024-04-25T20:47:06.137669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752868+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:47:05.752868+0000","last_peered":"2024-04-25T20:47:05.752868+0000","last_clean":"2024-04-25T20:47:05.752868+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:47:05.752868+0000","last_undegraded":"2024-04-25T20:47:05.752868+0000","last_fullsized":"2024-04-25T20:47:05.752868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750196+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:47:05.750196+0000","last_peered":"2024-04-25T20:47:05.750196+0000","last_clean":"2024-04-25T20:47:05.750196+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:47:05.750196+0000","last_undegraded":"2024-04-25T20:47:05.750196+0000","last_fullsized":"2024-04-25T20:47:05.750196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137753+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:47:06.137753+0000","last_peered":"2024-04-25T20:47:06.137753+0000","last_clean":"2024-04-25T20:47:06.137753+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:47:06.137753+0000","last_undegraded":"2024-04-25T20:47:06.137753+0000","last_fullsized":"2024-04-25T20:47:06.137753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.761066+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:47:05.761066+0000","last_peered":"2024-04-25T20:47:05.761066+0000","last_clean":"2024-04-25T20:47:05.761066+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:47:05.761066+0000","last_undegraded":"2024-04-25T20:47:05.761066+0000","last_fullsized":"2024-04-25T20:47:05.761066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754473+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:47:05.754473+0000","last_peered":"2024-04-25T20:47:05.754473+0000","last_clean":"2024-04-25T20:47:05.754473+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:47:05.754473+0000","last_undegraded":"2024-04-25T20:47:05.754473+0000","last_fullsized":"2024-04-25T20:47:05.754473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:08.536324+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:47:08.536324+0000","last_peered":"2024-04-25T20:47:08.536324+0000","last_clean":"2024-04-25T20:47:08.536324+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:47:08.536324+0000","last_undegraded":"2024-04-25T20:47:08.536324+0000","last_fullsized":"2024-04-25T20:47:08.536324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754966+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:47:05.754966+0000","last_peered":"2024-04-25T20:47:05.754966+0000","last_clean":"2024-04-25T20:47:05.754966+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:47:05.754966+0000","last_undegraded":"2024-04-25T20:47:05.754966+0000","last_fullsized":"2024-04-25T20:47:05.754966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754281+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:47:05.754281+0000","last_peered":"2024-04-25T20:47:05.754281+0000","last_clean":"2024-04-25T20:47:05.754281+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:47:05.754281+0000","last_undegraded":"2024-04-25T20:47:05.754281+0000","last_fullsized":"2024-04-25T20:47:05.754281+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754715+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:47:05.754715+0000","last_peered":"2024-04-25T20:47:05.754715+0000","last_clean":"2024-04-25T20:47:05.754715+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:47:05.754715+0000","last_undegraded":"2024-04-25T20:47:05.754715+0000","last_fullsized":"2024-04-25T20:47:05.754715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751385+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:47:05.751385+0000","last_peered":"2024-04-25T20:47:05.751385+0000","last_clean":"2024-04-25T20:47:05.751385+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:47:05.751385+0000","last_undegraded":"2024-04-25T20:47:05.751385+0000","last_fullsized":"2024-04-25T20:47:05.751385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754916+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:47:05.754916+0000","last_peered":"2024-04-25T20:47:05.754916+0000","last_clean":"2024-04-25T20:47:05.754916+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:47:05.754916+0000","last_undegraded":"2024-04-25T20:47:05.754916+0000","last_fullsized":"2024-04-25T20:47:05.754916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752915+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:47:05.752915+0000","last_peered":"2024-04-25T20:47:05.752915+0000","last_clean":"2024-04-25T20:47:05.752915+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:47:05.752915+0000","last_undegraded":"2024-04-25T20:47:05.752915+0000","last_fullsized":"2024-04-25T20:47:05.752915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750625+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:47:05.750625+0000","last_peered":"2024-04-25T20:47:05.750625+0000","last_clean":"2024-04-25T20:47:05.750625+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:47:05.750625+0000","last_undegraded":"2024-04-25T20:47:05.750625+0000","last_fullsized":"2024-04-25T20:47:05.750625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750060+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:47:05.750060+0000","last_peered":"2024-04-25T20:47:05.750060+0000","last_clean":"2024-04-25T20:47:05.750060+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:47:05.750060+0000","last_undegraded":"2024-04-25T20:47:05.750060+0000","last_fullsized":"2024-04-25T20:47:05.750060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754034+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:47:05.754034+0000","last_peered":"2024-04-25T20:47:05.754034+0000","last_clean":"2024-04-25T20:47:05.754034+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:47:05.754034+0000","last_undegraded":"2024-04-25T20:47:05.754034+0000","last_fullsized":"2024-04-25T20:47:05.754034+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751248+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:47:05.751248+0000","last_peered":"2024-04-25T20:47:05.751248+0000","last_clean":"2024-04-25T20:47:05.751248+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:47:05.751248+0000","last_undegraded":"2024-04-25T20:47:05.751248+0000","last_fullsized":"2024-04-25T20:47:05.751248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752899+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:47:05.752899+0000","last_peered":"2024-04-25T20:47:05.752899+0000","last_clean":"2024-04-25T20:47:05.752899+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:47:05.752899+0000","last_undegraded":"2024-04-25T20:47:05.752899+0000","last_fullsized":"2024-04-25T20:47:05.752899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750546+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:47:05.750546+0000","last_peered":"2024-04-25T20:47:05.750546+0000","last_clean":"2024-04-25T20:47:05.750546+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:47:05.750546+0000","last_undegraded":"2024-04-25T20:47:05.750546+0000","last_fullsized":"2024-04-25T20:47:05.750546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137933+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:47:06.137933+0000","last_peered":"2024-04-25T20:47:06.137933+0000","last_clean":"2024-04-25T20:47:06.137933+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:47:06.137933+0000","last_undegraded":"2024-04-25T20:47:06.137933+0000","last_fullsized":"2024-04-25T20:47:06.137933+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.139648+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:47:06.139648+0000","last_peered":"2024-04-25T20:47:06.139648+0000","last_clean":"2024-04-25T20:47:06.139648+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:47:06.139648+0000","last_undegraded":"2024-04-25T20:47:06.139648+0000","last_fullsized":"2024-04-25T20:47:06.139648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137586+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:47:06.137586+0000","last_peered":"2024-04-25T20:47:06.137586+0000","last_clean":"2024-04-25T20:47:06.137586+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:47:06.137586+0000","last_undegraded":"2024-04-25T20:47:06.137586+0000","last_fullsized":"2024-04-25T20:47:06.137586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750370+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:47:05.750370+0000","last_peered":"2024-04-25T20:47:05.750370+0000","last_clean":"2024-04-25T20:47:05.750370+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:47:05.750370+0000","last_undegraded":"2024-04-25T20:47:05.750370+0000","last_fullsized":"2024-04-25T20:47:05.750370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751536+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:47:05.751536+0000","last_peered":"2024-04-25T20:47:05.751536+0000","last_clean":"2024-04-25T20:47:05.751536+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:47:05.751536+0000","last_undegraded":"2024-04-25T20:47:05.751536+0000","last_fullsized":"2024-04-25T20:47:05.751536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752730+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:47:05.752730+0000","last_peered":"2024-04-25T20:47:05.752730+0000","last_clean":"2024-04-25T20:47:05.752730+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:47:05.752730+0000","last_undegraded":"2024-04-25T20:47:05.752730+0000","last_fullsized":"2024-04-25T20:47:05.752730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284027,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62353,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":289,"num_read_kb":214,"num_write":239,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":187059,"data_compressed":5466,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":483941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712856,"statfs":{"total":95995035648,"available":95961964544,"internally_reserved":0,"allocated":1142784,"data_stored":1129337,"data_compressed":37940,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":483480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037800,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1015808,"data_stored":483858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1077158,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":483588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":538868,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":484927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":539479,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1019904,"data_stored":483022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888124,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":483449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724600,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1081344,"data_stored":1076054,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":56510,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":57121,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":56494,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:47:15.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:47:15.921 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:15 smithi043 ceph-mon[29167]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:16.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:15 smithi043 ceph-mon[29167]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:15 smithi195 ceph-mon[33250]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:16.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:15 smithi195 ceph-mon[33250]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:15 smithi112 ceph-mon[32322]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:15 smithi112 ceph-mon[32322]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 -- 172.21.15.43:0/2987683233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 msgr2=0x7f6f2006b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 --2- 172.21.15.43:0/2987683233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f2006b1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009990 tx=0x7f6f08009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 -- 172.21.15.43:0/2987683233 shutdown_connections 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 --2- 172.21.15.43:0/2987683233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 0x7f6f20105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 --2- 172.21.15.43:0/2987683233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f2006b1f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 --2- 172.21.15.43:0/2987683233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2006bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 -- 172.21.15.43:0/2987683233 >> 172.21.15.43:0/2987683233 conn(0x7f6f200789e0 msgr2=0x7f6f20078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 -- 172.21.15.43:0/2987683233 shutdown_connections 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 -- 172.21.15.43:0/2987683233 wait complete. 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.683+0000 7f6f254d2700 1 Processor -- start 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 -- start start 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 0x7f6f2019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20119360 con 0x7f6f201079a0 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201191e0 con 0x7f6f201054b0 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f254d2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201194e0 con 0x7f6f2006b730 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44462/0 (socket says 172.21.15.43:44462) 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 -- 172.21.15.43:0/1964649988 learned_addr learned my addr 172.21.15.43:0/1964649988 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1e7fc700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 0x7f6f2019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1effd700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 -- 172.21.15.43:0/1964649988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 msgr2=0x7f6f2019f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2019f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 -- 172.21.15.43:0/1964649988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 msgr2=0x7f6f2019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 0x7f6f2019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 -- 172.21.15.43:0/1964649988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f201a4740 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1effd700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2019f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.684+0000 7f6f1f7fe700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007d70 tx=0x7f6f1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18016020 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f1800ad40 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f201a4a30 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f180116f0 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201ac2b0 con 0x7f6f201079a0 2024-04-25T20:47:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.685+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f20069730 con 0x7f6f201079a0 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.687+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6f18019020 con 0x7f6f201079a0 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.687+0000 7f6f17fff700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 0x7f6f0c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.687+0000 7f6f1effd700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 0x7f6f0c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.688+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f6f180d08a0 con 0x7f6f201079a0 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.688+0000 7f6f1effd700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 0x7f6f0c0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.692+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6f18020020 con 0x7f6f201079a0 2024-04-25T20:47:17.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.896+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f20104ba0 con 0x7f6f0c0a3cd0 2024-04-25T20:47:17.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.904+0000 7f6f17fff700 1 -- 172.21.15.43:0/1964649988 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258991 (secure 0 0 0) 0x7f6f20104ba0 con 0x7f6f0c0a3cd0 2024-04-25T20:47:17.908 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.906+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 msgr2=0x7f6f0c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.906+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 0x7f6f0c0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08005fb0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.906+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 msgr2=0x7f6f201a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.906+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007d70 tx=0x7f6f1800a340 comp rx=0 tx=0).stop 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 shutdown_connections 2024-04-25T20:47:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f0c0a3cd0 0x7f6f0c0a6190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f2006b730 0x7f6f2019f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f201079a0 0x7f6f201a4000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 --2- 172.21.15.43:0/1964649988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f201054b0 0x7f6f2019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 >> 172.21.15.43:0/1964649988 conn(0x7f6f200789e0 msgr2=0x7f6f20104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 shutdown_connections 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:17.907+0000 7f6f254d2700 1 -- 172.21.15.43:0/1964649988 wait complete. 2024-04-25T20:47:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:47:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:17 smithi043 ceph-mon[29167]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:17 smithi195 ceph-mon[33250]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:17 smithi112 ceph-mon[32322]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:18.615 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-04-25T20:47:16.677244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661660,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":466,"num_read_kb":362,"num_write":429,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390552,"kb_used_data":12232,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551272,"statfs":{"total":1151940427776,"available":1151540502528,"internally_reserved":0,"allocated":12525568,"data_stored":7764571,"data_compressed":113820,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36244,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":100,"num_write":22,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.928806"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753171+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:47:05.753171+0000","last_peered":"2024-04-25T20:47:05.753171+0000","last_clean":"2024-04-25T20:47:05.753171+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:47:05.753171+0000","last_undegraded":"2024-04-25T20:47:05.753171+0000","last_fullsized":"2024-04-25T20:47:05.753171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753969+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:47:05.753969+0000","last_peered":"2024-04-25T20:47:05.753969+0000","last_clean":"2024-04-25T20:47:05.753969+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:47:05.753969+0000","last_undegraded":"2024-04-25T20:47:05.753969+0000","last_fullsized":"2024-04-25T20:47:05.753969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754116+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:47:05.754116+0000","last_peered":"2024-04-25T20:47:05.754116+0000","last_clean":"2024-04-25T20:47:05.754116+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:47:05.754116+0000","last_undegraded":"2024-04-25T20:47:05.754116+0000","last_fullsized":"2024-04-25T20:47:05.754116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.919019+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:47:05.919019+0000","last_peered":"2024-04-25T20:47:05.919019+0000","last_clean":"2024-04-25T20:47:05.919019+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:47:05.919019+0000","last_undegraded":"2024-04-25T20:47:05.919019+0000","last_fullsized":"2024-04-25T20:47:05.919019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756158+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:47:05.756158+0000","last_peered":"2024-04-25T20:47:05.756158+0000","last_clean":"2024-04-25T20:47:05.756158+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:47:05.756158+0000","last_undegraded":"2024-04-25T20:47:05.756158+0000","last_fullsized":"2024-04-25T20:47:05.756158+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.757617+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:47:05.757617+0000","last_peered":"2024-04-25T20:47:05.757617+0000","last_clean":"2024-04-25T20:47:05.757617+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:47:05.757617+0000","last_undegraded":"2024-04-25T20:47:05.757617+0000","last_fullsized":"2024-04-25T20:47:05.757617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754188+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:47:05.754188+0000","last_peered":"2024-04-25T20:47:05.754188+0000","last_clean":"2024-04-25T20:47:05.754188+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:47:05.754188+0000","last_undegraded":"2024-04-25T20:47:05.754188+0000","last_fullsized":"2024-04-25T20:47:05.754188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137789+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:47:06.137789+0000","last_peered":"2024-04-25T20:47:06.137789+0000","last_clean":"2024-04-25T20:47:06.137789+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:47:06.137789+0000","last_undegraded":"2024-04-25T20:47:06.137789+0000","last_fullsized":"2024-04-25T20:47:06.137789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750560+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:47:05.750560+0000","last_peered":"2024-04-25T20:47:05.750560+0000","last_clean":"2024-04-25T20:47:05.750560+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:47:05.750560+0000","last_undegraded":"2024-04-25T20:47:05.750560+0000","last_fullsized":"2024-04-25T20:47:05.750560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752879+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:47:05.752879+0000","last_peered":"2024-04-25T20:47:05.752879+0000","last_clean":"2024-04-25T20:47:05.752879+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:47:05.752879+0000","last_undegraded":"2024-04-25T20:47:05.752879+0000","last_fullsized":"2024-04-25T20:47:05.752879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754735+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:47:05.754735+0000","last_peered":"2024-04-25T20:47:05.754735+0000","last_clean":"2024-04-25T20:47:05.754735+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:47:05.754735+0000","last_undegraded":"2024-04-25T20:47:05.754735+0000","last_fullsized":"2024-04-25T20:47:05.754735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918857+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:47:05.918857+0000","last_peered":"2024-04-25T20:47:05.918857+0000","last_clean":"2024-04-25T20:47:05.918857+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:47:05.918857+0000","last_undegraded":"2024-04-25T20:47:05.918857+0000","last_fullsized":"2024-04-25T20:47:05.918857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751424+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:47:05.751424+0000","last_peered":"2024-04-25T20:47:05.751424+0000","last_clean":"2024-04-25T20:47:05.751424+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:47:05.751424+0000","last_undegraded":"2024-04-25T20:47:05.751424+0000","last_fullsized":"2024-04-25T20:47:05.751424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753402+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:47:05.753402+0000","last_peered":"2024-04-25T20:47:05.753402+0000","last_clean":"2024-04-25T20:47:05.753402+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:47:05.753402+0000","last_undegraded":"2024-04-25T20:47:05.753402+0000","last_fullsized":"2024-04-25T20:47:05.753402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753232+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:47:05.753232+0000","last_peered":"2024-04-25T20:47:05.753232+0000","last_clean":"2024-04-25T20:47:05.753232+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:47:05.753232+0000","last_undegraded":"2024-04-25T20:47:05.753232+0000","last_fullsized":"2024-04-25T20:47:05.753232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749984+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:47:05.749984+0000","last_peered":"2024-04-25T20:47:05.749984+0000","last_clean":"2024-04-25T20:47:05.749984+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:47:05.749984+0000","last_undegraded":"2024-04-25T20:47:05.749984+0000","last_fullsized":"2024-04-25T20:47:05.749984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753319+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:47:05.753319+0000","last_peered":"2024-04-25T20:47:05.753319+0000","last_clean":"2024-04-25T20:47:05.753319+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:47:05.753319+0000","last_undegraded":"2024-04-25T20:47:05.753319+0000","last_fullsized":"2024-04-25T20:47:05.753319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750440+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:47:05.750440+0000","last_peered":"2024-04-25T20:47:05.750440+0000","last_clean":"2024-04-25T20:47:05.750440+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:47:05.750440+0000","last_undegraded":"2024-04-25T20:47:05.750440+0000","last_fullsized":"2024-04-25T20:47:05.750440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:13.542098+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:47:13.542098+0000","last_peered":"2024-04-25T20:47:13.542098+0000","last_clean":"2024-04-25T20:47:13.542098+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:47:13.542098+0000","last_undegraded":"2024-04-25T20:47:13.542098+0000","last_fullsized":"2024-04-25T20:47:13.542098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137985+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:47:06.137985+0000","last_peered":"2024-04-25T20:47:06.137985+0000","last_clean":"2024-04-25T20:47:06.137985+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:47:06.137985+0000","last_undegraded":"2024-04-25T20:47:06.137985+0000","last_fullsized":"2024-04-25T20:47:06.137985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138170+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:47:06.138170+0000","last_peered":"2024-04-25T20:47:06.138170+0000","last_clean":"2024-04-25T20:47:06.138170+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:47:06.138170+0000","last_undegraded":"2024-04-25T20:47:06.138170+0000","last_fullsized":"2024-04-25T20:47:06.138170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754469+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:47:05.754469+0000","last_peered":"2024-04-25T20:47:05.754469+0000","last_clean":"2024-04-25T20:47:05.754469+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:47:05.754469+0000","last_undegraded":"2024-04-25T20:47:05.754469+0000","last_fullsized":"2024-04-25T20:47:05.754469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756813+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:47:05.756813+0000","last_peered":"2024-04-25T20:47:05.756813+0000","last_clean":"2024-04-25T20:47:05.756813+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:47:05.756813+0000","last_undegraded":"2024-04-25T20:47:05.756813+0000","last_fullsized":"2024-04-25T20:47:05.756813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750745+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:47:05.750745+0000","last_peered":"2024-04-25T20:47:05.750745+0000","last_clean":"2024-04-25T20:47:05.750745+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:47:05.750745+0000","last_undegraded":"2024-04-25T20:47:05.750745+0000","last_fullsized":"2024-04-25T20:47:05.750745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756533+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:47:05.756533+0000","last_peered":"2024-04-25T20:47:05.756533+0000","last_clean":"2024-04-25T20:47:05.756533+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:47:05.756533+0000","last_undegraded":"2024-04-25T20:47:05.756533+0000","last_fullsized":"2024-04-25T20:47:05.756533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754423+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:47:05.754423+0000","last_peered":"2024-04-25T20:47:05.754423+0000","last_clean":"2024-04-25T20:47:05.754423+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:47:05.754423+0000","last_undegraded":"2024-04-25T20:47:05.754423+0000","last_fullsized":"2024-04-25T20:47:05.754423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:14.544955+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:47:14.544955+0000","last_peered":"2024-04-25T20:47:14.544955+0000","last_clean":"2024-04-25T20:47:14.544955+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:47:14.544955+0000","last_undegraded":"2024-04-25T20:47:14.544955+0000","last_fullsized":"2024-04-25T20:47:14.544955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755999+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:47:05.755999+0000","last_peered":"2024-04-25T20:47:05.755999+0000","last_clean":"2024-04-25T20:47:05.755999+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:47:05.755999+0000","last_undegraded":"2024-04-25T20:47:05.755999+0000","last_fullsized":"2024-04-25T20:47:05.755999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752327+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:47:05.752327+0000","last_peered":"2024-04-25T20:47:05.752327+0000","last_clean":"2024-04-25T20:47:05.752327+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:47:05.752327+0000","last_undegraded":"2024-04-25T20:47:05.752327+0000","last_fullsized":"2024-04-25T20:47:05.752327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920027+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:47:05.920027+0000","last_peered":"2024-04-25T20:47:05.920027+0000","last_clean":"2024-04-25T20:47:05.920027+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:47:05.920027+0000","last_undegraded":"2024-04-25T20:47:05.920027+0000","last_fullsized":"2024-04-25T20:47:05.920027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751613+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:47:05.751613+0000","last_peered":"2024-04-25T20:47:05.751613+0000","last_clean":"2024-04-25T20:47:05.751613+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:47:05.751613+0000","last_undegraded":"2024-04-25T20:47:05.751613+0000","last_fullsized":"2024-04-25T20:47:05.751613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137900+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:47:06.137900+0000","last_peered":"2024-04-25T20:47:06.137900+0000","last_clean":"2024-04-25T20:47:06.137900+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:47:06.137900+0000","last_undegraded":"2024-04-25T20:47:06.137900+0000","last_fullsized":"2024-04-25T20:47:06.137900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754009+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:47:05.754009+0000","last_peered":"2024-04-25T20:47:05.754009+0000","last_clean":"2024-04-25T20:47:05.754009+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:47:05.754009+0000","last_undegraded":"2024-04-25T20:47:05.754009+0000","last_fullsized":"2024-04-25T20:47:05.754009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749633+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:47:05.749633+0000","last_peered":"2024-04-25T20:47:05.749633+0000","last_clean":"2024-04-25T20:47:05.749633+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:47:05.749633+0000","last_undegraded":"2024-04-25T20:47:05.749633+0000","last_fullsized":"2024-04-25T20:47:05.749633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:15.545282+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:47:15.545282+0000","last_peered":"2024-04-25T20:47:15.545282+0000","last_clean":"2024-04-25T20:47:15.545282+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:47:15.545282+0000","last_undegraded":"2024-04-25T20:47:15.545282+0000","last_fullsized":"2024-04-25T20:47:15.545282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750667+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:47:05.750667+0000","last_peered":"2024-04-25T20:47:05.750667+0000","last_clean":"2024-04-25T20:47:05.750667+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:47:05.750667+0000","last_undegraded":"2024-04-25T20:47:05.750667+0000","last_fullsized":"2024-04-25T20:47:05.750667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754768+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:47:05.754768+0000","last_peered":"2024-04-25T20:47:05.754768+0000","last_clean":"2024-04-25T20:47:05.754768+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:47:05.754768+0000","last_undegraded":"2024-04-25T20:47:05.754768+0000","last_fullsized":"2024-04-25T20:47:05.754768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754394+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:47:05.754394+0000","last_peered":"2024-04-25T20:47:05.754394+0000","last_clean":"2024-04-25T20:47:05.754394+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:47:05.754394+0000","last_undegraded":"2024-04-25T20:47:05.754394+0000","last_fullsized":"2024-04-25T20:47:05.754394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754546+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:47:05.754546+0000","last_peered":"2024-04-25T20:47:05.754546+0000","last_clean":"2024-04-25T20:47:05.754546+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:47:05.754546+0000","last_undegraded":"2024-04-25T20:47:05.754546+0000","last_fullsized":"2024-04-25T20:47:05.754546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750258+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:47:05.750258+0000","last_peered":"2024-04-25T20:47:05.750258+0000","last_clean":"2024-04-25T20:47:05.750258+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:47:05.750258+0000","last_undegraded":"2024-04-25T20:47:05.750258+0000","last_fullsized":"2024-04-25T20:47:05.750258+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'32","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:15.545335+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:47:15.545335+0000","last_peered":"2024-04-25T20:47:15.545335+0000","last_clean":"2024-04-25T20:47:15.545335+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:47:15.545335+0000","last_undegraded":"2024-04-25T20:47:15.545335+0000","last_fullsized":"2024-04-25T20:47:15.545335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":95,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756435+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:47:05.756435+0000","last_peered":"2024-04-25T20:47:05.756435+0000","last_clean":"2024-04-25T20:47:05.756435+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:47:05.756435+0000","last_undegraded":"2024-04-25T20:47:05.756435+0000","last_fullsized":"2024-04-25T20:47:05.756435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750404+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:47:05.750404+0000","last_peered":"2024-04-25T20:47:05.750404+0000","last_clean":"2024-04-25T20:47:05.750404+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:47:05.750404+0000","last_undegraded":"2024-04-25T20:47:05.750404+0000","last_fullsized":"2024-04-25T20:47:05.750404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751149+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:47:05.751149+0000","last_peered":"2024-04-25T20:47:05.751149+0000","last_clean":"2024-04-25T20:47:05.751149+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:47:05.751149+0000","last_undegraded":"2024-04-25T20:47:05.751149+0000","last_fullsized":"2024-04-25T20:47:05.751149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753879+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:47:05.753879+0000","last_peered":"2024-04-25T20:47:05.753879+0000","last_clean":"2024-04-25T20:47:05.753879+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:47:05.753879+0000","last_undegraded":"2024-04-25T20:47:05.753879+0000","last_fullsized":"2024-04-25T20:47:05.753879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754629+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:47:05.754629+0000","last_peered":"2024-04-25T20:47:05.754629+0000","last_clean":"2024-04-25T20:47:05.754629+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:47:05.754629+0000","last_undegraded":"2024-04-25T20:47:05.754629+0000","last_fullsized":"2024-04-25T20:47:05.754629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:13.556873+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:47:13.556873+0000","last_peered":"2024-04-25T20:47:13.556873+0000","last_clean":"2024-04-25T20:47:13.556873+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:47:13.556873+0000","last_undegraded":"2024-04-25T20:47:13.556873+0000","last_fullsized":"2024-04-25T20:47:13.556873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754123+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:47:05.754123+0000","last_peered":"2024-04-25T20:47:05.754123+0000","last_clean":"2024-04-25T20:47:05.754123+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:47:05.754123+0000","last_undegraded":"2024-04-25T20:47:05.754123+0000","last_fullsized":"2024-04-25T20:47:05.754123+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755855+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:47:05.755855+0000","last_peered":"2024-04-25T20:47:05.755855+0000","last_clean":"2024-04-25T20:47:05.755855+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:47:05.755855+0000","last_undegraded":"2024-04-25T20:47:05.755855+0000","last_fullsized":"2024-04-25T20:47:05.755855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753858+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:47:05.753858+0000","last_peered":"2024-04-25T20:47:05.753858+0000","last_clean":"2024-04-25T20:47:05.753858+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:47:05.753858+0000","last_undegraded":"2024-04-25T20:47:05.753858+0000","last_fullsized":"2024-04-25T20:47:05.753858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756828+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:47:05.756828+0000","last_peered":"2024-04-25T20:47:05.756828+0000","last_clean":"2024-04-25T20:47:05.756828+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:47:05.756828+0000","last_undegraded":"2024-04-25T20:47:05.756828+0000","last_fullsized":"2024-04-25T20:47:05.756828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753110+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:47:05.753110+0000","last_peered":"2024-04-25T20:47:05.753110+0000","last_clean":"2024-04-25T20:47:05.753110+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:47:05.753110+0000","last_undegraded":"2024-04-25T20:47:05.753110+0000","last_fullsized":"2024-04-25T20:47:05.753110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750002+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:47:05.750002+0000","last_peered":"2024-04-25T20:47:05.750002+0000","last_clean":"2024-04-25T20:47:05.750002+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:47:05.750002+0000","last_undegraded":"2024-04-25T20:47:05.750002+0000","last_fullsized":"2024-04-25T20:47:05.750002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752528+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:47:05.752528+0000","last_peered":"2024-04-25T20:47:05.752528+0000","last_clean":"2024-04-25T20:47:05.752528+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:47:05.752528+0000","last_undegraded":"2024-04-25T20:47:05.752528+0000","last_fullsized":"2024-04-25T20:47:05.752528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'6","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:10.538405+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:47:10.538405+0000","last_peered":"2024-04-25T20:47:10.538405+0000","last_clean":"2024-04-25T20:47:10.538405+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:47:10.538405+0000","last_undegraded":"2024-04-25T20:47:10.538405+0000","last_fullsized":"2024-04-25T20:47:10.538405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755662+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:47:05.755662+0000","last_peered":"2024-04-25T20:47:05.755662+0000","last_clean":"2024-04-25T20:47:05.755662+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:47:05.755662+0000","last_undegraded":"2024-04-25T20:47:05.755662+0000","last_fullsized":"2024-04-25T20:47:05.755662+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920287+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:47:05.920287+0000","last_peered":"2024-04-25T20:47:05.920287+0000","last_clean":"2024-04-25T20:47:05.920287+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:47:05.920287+0000","last_undegraded":"2024-04-25T20:47:05.920287+0000","last_fullsized":"2024-04-25T20:47:05.920287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:11.552432+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:47:11.552432+0000","last_peered":"2024-04-25T20:47:11.552432+0000","last_clean":"2024-04-25T20:47:11.552432+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:47:11.552432+0000","last_undegraded":"2024-04-25T20:47:11.552432+0000","last_fullsized":"2024-04-25T20:47:11.552432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137869+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:47:06.137869+0000","last_peered":"2024-04-25T20:47:06.137869+0000","last_clean":"2024-04-25T20:47:06.137869+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:47:06.137869+0000","last_undegraded":"2024-04-25T20:47:06.137869+0000","last_fullsized":"2024-04-25T20:47:06.137869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918830+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:47:05.918830+0000","last_peered":"2024-04-25T20:47:05.918830+0000","last_clean":"2024-04-25T20:47:05.918830+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:47:05.918830+0000","last_undegraded":"2024-04-25T20:47:05.918830+0000","last_fullsized":"2024-04-25T20:47:05.918830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754264+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:47:05.754264+0000","last_peered":"2024-04-25T20:47:05.754264+0000","last_clean":"2024-04-25T20:47:05.754264+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:47:05.754264+0000","last_undegraded":"2024-04-25T20:47:05.754264+0000","last_fullsized":"2024-04-25T20:47:05.754264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754986+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:47:05.754986+0000","last_peered":"2024-04-25T20:47:05.754986+0000","last_clean":"2024-04-25T20:47:05.754986+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:47:05.754986+0000","last_undegraded":"2024-04-25T20:47:05.754986+0000","last_fullsized":"2024-04-25T20:47:05.754986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754377+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:47:05.754377+0000","last_peered":"2024-04-25T20:47:05.754377+0000","last_clean":"2024-04-25T20:47:05.754377+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:47:05.754377+0000","last_undegraded":"2024-04-25T20:47:05.754377+0000","last_fullsized":"2024-04-25T20:47:05.754377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756624+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:47:05.756624+0000","last_peered":"2024-04-25T20:47:05.756624+0000","last_clean":"2024-04-25T20:47:05.756624+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:47:05.756624+0000","last_undegraded":"2024-04-25T20:47:05.756624+0000","last_fullsized":"2024-04-25T20:47:05.756624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751445+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:47:05.751445+0000","last_peered":"2024-04-25T20:47:05.751445+0000","last_clean":"2024-04-25T20:47:05.751445+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:47:05.751445+0000","last_undegraded":"2024-04-25T20:47:05.751445+0000","last_fullsized":"2024-04-25T20:47:05.751445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:09.498024+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:47:09.498024+0000","last_peered":"2024-04-25T20:47:09.498024+0000","last_clean":"2024-04-25T20:47:09.498024+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:47:09.498024+0000","last_undegraded":"2024-04-25T20:47:09.498024+0000","last_fullsized":"2024-04-25T20:47:09.498024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138035+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:47:06.138035+0000","last_peered":"2024-04-25T20:47:06.138035+0000","last_clean":"2024-04-25T20:47:06.138035+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:47:06.138035+0000","last_undegraded":"2024-04-25T20:47:06.138035+0000","last_fullsized":"2024-04-25T20:47:06.138035+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918866+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:47:05.918866+0000","last_peered":"2024-04-25T20:47:05.918866+0000","last_clean":"2024-04-25T20:47:05.918866+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:47:05.918866+0000","last_undegraded":"2024-04-25T20:47:05.918866+0000","last_fullsized":"2024-04-25T20:47:05.918866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754209+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:47:05.754209+0000","last_peered":"2024-04-25T20:47:05.754209+0000","last_clean":"2024-04-25T20:47:05.754209+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:47:05.754209+0000","last_undegraded":"2024-04-25T20:47:05.754209+0000","last_fullsized":"2024-04-25T20:47:05.754209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.758571+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:47:05.758571+0000","last_peered":"2024-04-25T20:47:05.758571+0000","last_clean":"2024-04-25T20:47:05.758571+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:47:05.758571+0000","last_undegraded":"2024-04-25T20:47:05.758571+0000","last_fullsized":"2024-04-25T20:47:05.758571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755850+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:47:05.755850+0000","last_peered":"2024-04-25T20:47:05.755850+0000","last_clean":"2024-04-25T20:47:05.755850+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:47:05.755850+0000","last_undegraded":"2024-04-25T20:47:05.755850+0000","last_fullsized":"2024-04-25T20:47:05.755850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137669+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:47:06.137669+0000","last_peered":"2024-04-25T20:47:06.137669+0000","last_clean":"2024-04-25T20:47:06.137669+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:47:06.137669+0000","last_undegraded":"2024-04-25T20:47:06.137669+0000","last_fullsized":"2024-04-25T20:47:06.137669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752868+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:47:05.752868+0000","last_peered":"2024-04-25T20:47:05.752868+0000","last_clean":"2024-04-25T20:47:05.752868+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:47:05.752868+0000","last_undegraded":"2024-04-25T20:47:05.752868+0000","last_fullsized":"2024-04-25T20:47:05.752868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750196+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:47:05.750196+0000","last_peered":"2024-04-25T20:47:05.750196+0000","last_clean":"2024-04-25T20:47:05.750196+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:47:05.750196+0000","last_undegraded":"2024-04-25T20:47:05.750196+0000","last_fullsized":"2024-04-25T20:47:05.750196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137753+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:47:06.137753+0000","last_peered":"2024-04-25T20:47:06.137753+0000","last_clean":"2024-04-25T20:47:06.137753+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:47:06.137753+0000","last_undegraded":"2024-04-25T20:47:06.137753+0000","last_fullsized":"2024-04-25T20:47:06.137753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.761066+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:47:05.761066+0000","last_peered":"2024-04-25T20:47:05.761066+0000","last_clean":"2024-04-25T20:47:05.761066+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:47:05.761066+0000","last_undegraded":"2024-04-25T20:47:05.761066+0000","last_fullsized":"2024-04-25T20:47:05.761066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754473+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:47:05.754473+0000","last_peered":"2024-04-25T20:47:05.754473+0000","last_clean":"2024-04-25T20:47:05.754473+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:47:05.754473+0000","last_undegraded":"2024-04-25T20:47:05.754473+0000","last_fullsized":"2024-04-25T20:47:05.754473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":64,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:13.543407+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:47:13.543407+0000","last_peered":"2024-04-25T20:47:13.543407+0000","last_clean":"2024-04-25T20:47:13.543407+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:47:13.543407+0000","last_undegraded":"2024-04-25T20:47:13.543407+0000","last_fullsized":"2024-04-25T20:47:13.543407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754966+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:47:05.754966+0000","last_peered":"2024-04-25T20:47:05.754966+0000","last_clean":"2024-04-25T20:47:05.754966+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:47:05.754966+0000","last_undegraded":"2024-04-25T20:47:05.754966+0000","last_fullsized":"2024-04-25T20:47:05.754966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754281+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:47:05.754281+0000","last_peered":"2024-04-25T20:47:05.754281+0000","last_clean":"2024-04-25T20:47:05.754281+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:47:05.754281+0000","last_undegraded":"2024-04-25T20:47:05.754281+0000","last_fullsized":"2024-04-25T20:47:05.754281+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754715+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:47:05.754715+0000","last_peered":"2024-04-25T20:47:05.754715+0000","last_clean":"2024-04-25T20:47:05.754715+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:47:05.754715+0000","last_undegraded":"2024-04-25T20:47:05.754715+0000","last_fullsized":"2024-04-25T20:47:05.754715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751385+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:47:05.751385+0000","last_peered":"2024-04-25T20:47:05.751385+0000","last_clean":"2024-04-25T20:47:05.751385+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:47:05.751385+0000","last_undegraded":"2024-04-25T20:47:05.751385+0000","last_fullsized":"2024-04-25T20:47:05.751385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754916+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:47:05.754916+0000","last_peered":"2024-04-25T20:47:05.754916+0000","last_clean":"2024-04-25T20:47:05.754916+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:47:05.754916+0000","last_undegraded":"2024-04-25T20:47:05.754916+0000","last_fullsized":"2024-04-25T20:47:05.754916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752915+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:47:05.752915+0000","last_peered":"2024-04-25T20:47:05.752915+0000","last_clean":"2024-04-25T20:47:05.752915+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:47:05.752915+0000","last_undegraded":"2024-04-25T20:47:05.752915+0000","last_fullsized":"2024-04-25T20:47:05.752915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750625+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:47:05.750625+0000","last_peered":"2024-04-25T20:47:05.750625+0000","last_clean":"2024-04-25T20:47:05.750625+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:47:05.750625+0000","last_undegraded":"2024-04-25T20:47:05.750625+0000","last_fullsized":"2024-04-25T20:47:05.750625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750060+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:47:05.750060+0000","last_peered":"2024-04-25T20:47:05.750060+0000","last_clean":"2024-04-25T20:47:05.750060+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:47:05.750060+0000","last_undegraded":"2024-04-25T20:47:05.750060+0000","last_fullsized":"2024-04-25T20:47:05.750060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754034+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:47:05.754034+0000","last_peered":"2024-04-25T20:47:05.754034+0000","last_clean":"2024-04-25T20:47:05.754034+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:47:05.754034+0000","last_undegraded":"2024-04-25T20:47:05.754034+0000","last_fullsized":"2024-04-25T20:47:05.754034+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751248+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:47:05.751248+0000","last_peered":"2024-04-25T20:47:05.751248+0000","last_clean":"2024-04-25T20:47:05.751248+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:47:05.751248+0000","last_undegraded":"2024-04-25T20:47:05.751248+0000","last_fullsized":"2024-04-25T20:47:05.751248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752899+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:47:05.752899+0000","last_peered":"2024-04-25T20:47:05.752899+0000","last_clean":"2024-04-25T20:47:05.752899+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:47:05.752899+0000","last_undegraded":"2024-04-25T20:47:05.752899+0000","last_fullsized":"2024-04-25T20:47:05.752899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750546+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:47:05.750546+0000","last_peered":"2024-04-25T20:47:05.750546+0000","last_clean":"2024-04-25T20:47:05.750546+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:47:05.750546+0000","last_undegraded":"2024-04-25T20:47:05.750546+0000","last_fullsized":"2024-04-25T20:47:05.750546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137933+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:47:06.137933+0000","last_peered":"2024-04-25T20:47:06.137933+0000","last_clean":"2024-04-25T20:47:06.137933+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:47:06.137933+0000","last_undegraded":"2024-04-25T20:47:06.137933+0000","last_fullsized":"2024-04-25T20:47:06.137933+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.139648+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:47:06.139648+0000","last_peered":"2024-04-25T20:47:06.139648+0000","last_clean":"2024-04-25T20:47:06.139648+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:47:06.139648+0000","last_undegraded":"2024-04-25T20:47:06.139648+0000","last_fullsized":"2024-04-25T20:47:06.139648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137586+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:47:06.137586+0000","last_peered":"2024-04-25T20:47:06.137586+0000","last_clean":"2024-04-25T20:47:06.137586+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:47:06.137586+0000","last_undegraded":"2024-04-25T20:47:06.137586+0000","last_fullsized":"2024-04-25T20:47:06.137586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750370+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:47:05.750370+0000","last_peered":"2024-04-25T20:47:05.750370+0000","last_clean":"2024-04-25T20:47:05.750370+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:47:05.750370+0000","last_undegraded":"2024-04-25T20:47:05.750370+0000","last_fullsized":"2024-04-25T20:47:05.750370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751536+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:47:05.751536+0000","last_peered":"2024-04-25T20:47:05.751536+0000","last_clean":"2024-04-25T20:47:05.751536+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:47:05.751536+0000","last_undegraded":"2024-04-25T20:47:05.751536+0000","last_fullsized":"2024-04-25T20:47:05.751536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752730+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:47:05.752730+0000","last_peered":"2024-04-25T20:47:05.752730+0000","last_clean":"2024-04-25T20:47:05.752730+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:47:05.752730+0000","last_undegraded":"2024-04-25T20:47:05.752730+0000","last_fullsized":"2024-04-25T20:47:05.752730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284027,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71058,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":330,"num_read_kb":243,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":204469,"data_compressed":5466,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351001,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":483941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612638,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":1138042,"data_compressed":37940,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776164,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":483480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037800,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1015808,"data_stored":483858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1077158,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":483588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":538868,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":484927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":548184,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":483022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888125,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":483449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1081344,"data_stored":1076054,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":56510,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65826,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65199,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:47:18.620 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T20:47:18.620 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T20:47:18.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T20:47:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:18.997 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:18 smithi043 ceph-mon[29167]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:19.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:18 smithi195 ceph-mon[33250]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:19.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:18 smithi112 ceph-mon[32322]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:47:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:19 smithi043 ceph-mon[29167]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:20.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:19 smithi195 ceph-mon[33250]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:19 smithi112 ceph-mon[32322]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 -- 172.21.15.43:0/867431998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80103cd0 msgr2=0x7f4b80104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 --2- 172.21.15.43:0/867431998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80103cd0 0x7f4b80104130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b740099c0 tx=0x7f4b74009cd0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 -- 172.21.15.43:0/867431998 shutdown_connections 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 --2- 172.21.15.43:0/867431998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 0x7f4b80102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 --2- 172.21.15.43:0/867431998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80104670 0x7f4b8010af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 --2- 172.21.15.43:0/867431998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80103cd0 0x7f4b80104130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 -- 172.21.15.43:0/867431998 >> 172.21.15.43:0/867431998 conn(0x7f4b800fe090 msgr2=0x7f4b801004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 -- 172.21.15.43:0/867431998 shutdown_connections 2024-04-25T20:47:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.698+0000 7f4b85c13700 1 -- 172.21.15.43:0/867431998 wait complete. 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 Processor -- start 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 -- start start 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 0x7f4b800767e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80103cd0 0x7f4b80074e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:20.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010e680 con 0x7f4b80104670 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010e500 con 0x7f4b80103cd0 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b85c13700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010e800 con 0x7f4b80102ad0 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44476/0 (socket says 172.21.15.43:44476) 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.699+0000 7f4b7ffff700 1 -- 172.21.15.43:0/3763673209 learned_addr learned my addr 172.21.15.43:0/3763673209 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7effd700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80103cd0 0x7f4b80074e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7f7fe700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 0x7f4b800767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 -- 172.21.15.43:0/3763673209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 msgr2=0x7f4b800767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 0x7f4b800767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 -- 172.21.15.43:0/3763673209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80103cd0 msgr2=0x7f4b80074e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80103cd0 0x7f4b80074e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 -- 172.21.15.43:0/3763673209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80075c20 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7ffff700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4b78007ee0 tx=0x7f4b7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78004bb0 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b78004d50 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780059e0 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b801a2d30 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.700+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a3190 con 0x7f4b80104670 2024-04-25T20:47:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.701+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80050fc0 con 0x7f4b80104670 2024-04-25T20:47:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.703+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4b7801a020 con 0x7f4b80104670 2024-04-25T20:47:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.703+0000 7f4b7cff9700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 0x7f4b680a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.704+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f4b780d0220 con 0x7f4b80104670 2024-04-25T20:47:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.704+0000 7f4b7f7fe700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 0x7f4b680a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.704+0000 7f4b7f7fe700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 0x7f4b680a62c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b80103b30 tx=0x7f4b7000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:20.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:20.707+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b78010070 con 0x7f4b80104670 2024-04-25T20:47:21.005 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:20 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:47:21.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.004+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4b8002df80 con 0x7f4b80104670 2024-04-25T20:47:21.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.007+0000 7f4b7cff9700 1 -- 172.21.15.43:0/3763673209 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f4b7809ca50 con 0x7f4b80104670 2024-04-25T20:47:21.007 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-25T20:47:21.007 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQBZwSpm7H1XABAAohMlpNQkkEDcQDkLowSZPw== 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 msgr2=0x7f4b680a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 0x7f4b680a62c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b80103b30 tx=0x7f4b7000b410 comp rx=0 tx=0).stop 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 msgr2=0x7f4b80075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4b78007ee0 tx=0x7f4b7800d3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 shutdown_connections 2024-04-25T20:47:21.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f4b680a3e00 0x7f4b680a62c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b80102ad0 0x7f4b800767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b80104670 0x7f4b80075370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 --2- 172.21.15.43:0/3763673209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b80103cd0 0x7f4b80074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 >> 172.21.15.43:0/3763673209 conn(0x7f4b800fe090 msgr2=0x7f4b80106f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 shutdown_connections 2024-04-25T20:47:21.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:21.009+0000 7f4b85c13700 1 -- 172.21.15.43:0/3763673209 wait complete. 2024-04-25T20:47:21.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:20 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:47:21.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:20 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:47:21.722 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:47:21.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T20:47:21.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T20:47:21.762 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T20:47:21.763 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T20:47:21.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T20:47:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:21 smithi043 ceph-mon[29167]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:47:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:21 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T20:47:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:21 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T20:47:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:21 smithi195 ceph-mon[33250]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:47:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:21 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T20:47:22.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:21 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T20:47:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:21 smithi112 ceph-mon[32322]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:47:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:21 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T20:47:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:21 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3763673209' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T20:47:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:23.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:23 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:23 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:23.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:23 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:24.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 -- 172.21.15.43:0/4232552902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf41022f0 msgr2=0x7fccf410e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:24.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 --2- 172.21.15.43:0/4232552902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf41022f0 0x7fccf410e7e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009990 tx=0x7fcce4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 -- 172.21.15.43:0/4232552902 shutdown_connections 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 --2- 172.21.15.43:0/4232552902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf41022f0 0x7fccf410e7e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 --2- 172.21.15.43:0/4232552902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4107980 0x7fccf4107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 --2- 172.21.15.43:0/4232552902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf4101930 0x7fccf4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 -- 172.21.15.43:0/4232552902 >> 172.21.15.43:0/4232552902 conn(0x7fccf40788b0 msgr2=0x7fccf4078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 -- 172.21.15.43:0/4232552902 shutdown_connections 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.550+0000 7fccfaecf700 1 -- 172.21.15.43:0/4232552902 wait complete. 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 Processor -- start 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 -- start start 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 0x7fccf4198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf41022f0 0x7fccf4198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4111c80 con 0x7fccf4107980 2024-04-25T20:47:24.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4111b00 con 0x7fccf4101930 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccfaecf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4111e00 con 0x7fccf41022f0 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44498/0 (socket says 172.21.15.43:44498) 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 -- 172.21.15.43:0/1153761163 learned_addr learned my addr 172.21.15.43:0/1153761163 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf3fff700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf41022f0 0x7fccf4198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf8c6b700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 0x7fccf4198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 -- 172.21.15.43:0/1153761163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf41022f0 msgr2=0x7fccf4198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf41022f0 0x7fccf4198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 -- 172.21.15.43:0/1153761163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 msgr2=0x7fccf4198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 0x7fccf4198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 -- 172.21.15.43:0/1153761163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf419d160 con 0x7fccf4107980 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf8c6b700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 0x7fccf4198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.551+0000 7fccf946c700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005ef0 tx=0x7fcce4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:24.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.552+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4026070 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.552+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcce4005500 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.552+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf419d3f0 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.552+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004920 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.552+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf406afb0 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.553+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf4103050 con 0x7fccf4107980 2024-04-25T20:47:24.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.554+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fcce4029070 con 0x7fccf4107980 2024-04-25T20:47:24.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.555+0000 7fccf1ffb700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 0x7fccdc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:24.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.555+0000 7fccf8c6b700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 0x7fccdc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:24.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.555+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fcce40d1350 con 0x7fccf4107980 2024-04-25T20:47:24.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.555+0000 7fccf8c6b700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 0x7fccdc0a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fccec00e350 tx=0x7fccec009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:24.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.559+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcce4030020 con 0x7fccf4107980 2024-04-25T20:47:24.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:24 smithi043 ceph-mon[29167]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T20:47:24.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.841+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fccf41994b0 con 0x7fccf4107980 2024-04-25T20:47:24.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:24 smithi195 ceph-mon[33250]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T20:47:24.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:24 smithi112 ceph-mon[32322]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T20:47:24.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.846+0000 7fccf1ffb700 1 -- 172.21.15.43:0/1153761163 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264996 (secure 0 0 0) 0x7fcce4013070 con 0x7fccf4107980 2024-04-25T20:47:24.849 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:24.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 msgr2=0x7fccdc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:24.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 0x7fccdc0a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fccec00e350 tx=0x7fccec009040 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 msgr2=0x7fccf419ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005ef0 tx=0x7fcce4009ee0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 shutdown_connections 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fccdc0a3cd0 0x7fccdc0a6190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccf4107980 0x7fccf419ca20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fccf4101930 0x7fccf4198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 --2- 172.21.15.43:0/1153761163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccf41022f0 0x7fccf4198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 >> 172.21.15.43:0/1153761163 conn(0x7fccf40788b0 msgr2=0x7fccf40ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 shutdown_connections 2024-04-25T20:47:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:24.850+0000 7fccfaecf700 1 -- 172.21.15.43:0/1153761163 wait complete. 2024-04-25T20:47:25.612 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3531160359},{"type":"v1","addr":"172.21.15.43:6801","nonce":3531160359}]},"active_addr":"172.21.15.43:6801/3531160359","active_change":"2024-04-25T20:39:04.573044+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.43:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3360697116}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":801305986}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1350680357}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1916899701}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":345039429}]}]} 2024-04-25T20:47:25.619 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T20:47:25.619 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T20:47:25.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:47:25.879 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:26.003 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:25 smithi043 ceph-mon[29167]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-25T20:47:26.003 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:25 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.003 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:25 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.003 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1153761163' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T20:47:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:25 smithi195 ceph-mon[33250]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-25T20:47:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:25 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:25 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1153761163' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:25 smithi112 ceph-mon[32322]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:25 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:25 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1153761163' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T20:47:27.043 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:47:27.043 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:47:27.043 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:27.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:47:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:47:27.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:27.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:47:27.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:47:27.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 -- 172.21.15.43:0/597070458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc108a70 msgr2=0x7fb1bc108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 --2- 172.21.15.43:0/597070458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc108a70 0x7fb1bc108e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400b0a0 tx=0x7fb1b400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 -- 172.21.15.43:0/597070458 shutdown_connections 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 --2- 172.21.15.43:0/597070458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 0x7fb1bc10f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 --2- 172.21.15.43:0/597070458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc108a70 0x7fb1bc108e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 --2- 172.21.15.43:0/597070458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 -- 172.21.15.43:0/597070458 >> 172.21.15.43:0/597070458 conn(0x7fb1bc079bb0 msgr2=0x7fb1bc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 -- 172.21.15.43:0/597070458 shutdown_connections 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.542+0000 7fb1c3374700 1 -- 172.21.15.43:0/597070458 wait complete. 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 Processor -- start 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 -- start start 2024-04-25T20:47:27.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 0x7fb1bc075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc108a70 0x7fb1bc0757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc112d60 con 0x7fb1bc102ac0 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc112be0 con 0x7fb1bc103480 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c3374700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc112ee0 con 0x7fb1bc108a70 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c1110700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c1110700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48614/0 (socket says 172.21.15.43:48614) 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c1110700 1 -- 172.21.15.43:0/599181044 learned_addr learned my addr 172.21.15.43:0/599181044 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.543+0000 7fb1c090f700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 0x7fb1bc075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1911700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc108a70 0x7fb1bc0757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 -- 172.21.15.43:0/599181044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc108a70 msgr2=0x7fb1bc0757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc108a70 0x7fb1bc0757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 -- 172.21.15.43:0/599181044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 msgr2=0x7fb1bc075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:27.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 0x7fb1bc075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 -- 172.21.15.43:0/599181044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc1a76a0 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c1110700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40062a0 tx=0x7fb1b4007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4021070 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc1a7930 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b4007e30 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b401bcf0 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.544+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc1a7e70 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.545+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc069730 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.546+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb1b4024070 con 0x7fb1bc102ac0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.547+0000 7fb1ba7fc700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 0x7fb1a40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.547+0000 7fb1c090f700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 0x7fb1a40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:27.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.547+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb1b400f020 con 0x7fb1bc102ac0 2024-04-25T20:47:27.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.547+0000 7fb1c090f700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 0x7fb1a40a6190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005ea0 tx=0x7fb1b0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:27.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.551+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1b402b070 con 0x7fb1bc102ac0 2024-04-25T20:47:27.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.760+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1bc02e140 con 0x7fb1bc102ac0 2024-04-25T20:47:27.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.761+0000 7fb1ba7fc700 1 -- 172.21.15.43:0/599181044 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22627 (secure 0 0 0) 0x7fb1b409dfe0 con 0x7fb1bc102ac0 2024-04-25T20:47:27.762 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:27.763 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":91,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:47:05.741996+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:47:27.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 msgr2=0x7fb1a40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 0x7fb1a40a6190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005ea0 tx=0x7fb1b0005e30 comp rx=0 tx=0).stop 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 msgr2=0x7fb1bc074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40062a0 tx=0x7fb1b4007ad0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 shutdown_connections 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1a40a3cd0 0x7fb1a40a6190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1bc108a70 0x7fb1bc0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc102ac0 0x7fb1bc074d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 --2- 172.21.15.43:0/599181044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1bc103480 0x7fb1bc075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:27.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 >> 172.21.15.43:0/599181044 conn(0x7fb1bc079bb0 msgr2=0x7fb1bc101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:27.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 shutdown_connections 2024-04-25T20:47:27.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:27.764+0000 7fb1c3374700 1 -- 172.21.15.43:0/599181044 wait complete. 2024-04-25T20:47:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:27 smithi043 ceph-mon[29167]: pgmap v332: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-25T20:47:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:27 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/599181044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:27 smithi195 ceph-mon[33250]: pgmap v332: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-25T20:47:28.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:27 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/599181044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:28.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:27 smithi112 ceph-mon[32322]: pgmap v332: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-25T20:47:28.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:27 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/599181044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:28.510 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T20:47:28.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:47:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:29.935 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:29 smithi043 ceph-mon[29167]: pgmap v333: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:29 smithi195 ceph-mon[33250]: pgmap v333: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:29 smithi112 ceph-mon[32322]: pgmap v333: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 -- 172.21.15.43:0/42880495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430102ac0 msgr2=0x7f7430102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 --2- 172.21.15.43:0/42880495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430102ac0 0x7f7430102f40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7418009990 tx=0x7f7418009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 -- 172.21.15.43:0/42880495 shutdown_connections 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 --2- 172.21.15.43:0/42880495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f743010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 --2- 172.21.15.43:0/42880495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430108ab0 0x7f7430108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 --2- 172.21.15.43:0/42880495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430102ac0 0x7f7430102f40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 -- 172.21.15.43:0/42880495 >> 172.21.15.43:0/42880495 conn(0x7f7430079bf0 msgr2=0x7f743007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 -- 172.21.15.43:0/42880495 shutdown_connections 2024-04-25T20:47:30.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.460+0000 7f7435154700 1 -- 172.21.15.43:0/42880495 wait complete. 2024-04-25T20:47:30.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 Processor -- start 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 -- start start 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430102ac0 0x7f7430074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f7430075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7430112db0 con 0x7f7430108ab0 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7430112c30 con 0x7f7430102ac0 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f7435154700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7430112f30 con 0x7f7430103480 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f742f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f742f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48644/0 (socket says 172.21.15.43:48644) 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f742f59e700 1 -- 172.21.15.43:0/3812646790 learned_addr learned my addr 172.21.15.43:0/3812646790 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.461+0000 7f742ed9d700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430102ac0 0x7f7430074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:30.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742e59c700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f7430075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 -- 172.21.15.43:0/3812646790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 msgr2=0x7f7430075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f7430075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 -- 172.21.15.43:0/3812646790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430102ac0 msgr2=0x7f7430074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430102ac0 0x7f7430074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 -- 172.21.15.43:0/3812646790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74301a7740 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742e59c700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f7430075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f742f59e700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7420007ee0 tx=0x7f742000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742000dbd0 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f742000dd70 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74301a7a30 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420005a50 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.462+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74301a7f20 con 0x7f7430108ab0 2024-04-25T20:47:30.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.463+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7430069730 con 0x7f7430108ab0 2024-04-25T20:47:30.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.464+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f742001a020 con 0x7f7430108ab0 2024-04-25T20:47:30.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.465+0000 7f7427fff700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 0x7f741c0a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:30.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.465+0000 7f742ed9d700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 0x7f741c0a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:30.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.465+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f74200d03b0 con 0x7f7430108ab0 2024-04-25T20:47:30.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.466+0000 7f742ed9d700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 0x7f741c0a6330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f742800abd0 tx=0x7f742800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:30.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.469+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7420010070 con 0x7f7430108ab0 2024-04-25T20:47:30.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.677+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f743002e140 con 0x7f7430108ab0 2024-04-25T20:47:30.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.679+0000 7f7427fff700 1 -- 172.21.15.43:0/3812646790 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22627 (secure 0 0 0) 0x7f742009cc40 con 0x7f7430108ab0 2024-04-25T20:47:30.679 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:47:30.680 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":91,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:47:05.741996+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:47:30.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 msgr2=0x7f741c0a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 0x7f741c0a6330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f742800abd0 tx=0x7f742800a380 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 msgr2=0x7f74300757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7420007ee0 tx=0x7f742000d3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 shutdown_connections 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f741c0a3e70 0x7f741c0a6330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7430108ab0 0x7f74300757c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7430102ac0 0x7f7430074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 --2- 172.21.15.43:0/3812646790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7430103480 0x7f7430075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 >> 172.21.15.43:0/3812646790 conn(0x7f7430079bf0 msgr2=0x7f7430100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 shutdown_connections 2024-04-25T20:47:30.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:30.681+0000 7f7435154700 1 -- 172.21.15.43:0/3812646790 wait complete. 2024-04-25T20:47:31.123 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:30 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3812646790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:31.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:30 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3812646790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:31.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:30 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3812646790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:47:31.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T20:47:31.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T20:47:31.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T20:47:31.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T20:47:31.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T20:47:31.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T20:47:31.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-25T20:47:31.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-25T20:47:31.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-25T20:47:31.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-25T20:47:31.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-25T20:47:31.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-25T20:47:32.161 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.163 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.165 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.169 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.173 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.178 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:32.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:31 smithi043 ceph-mon[29167]: pgmap v334: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:31 smithi195 ceph-mon[33250]: pgmap v334: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:31 smithi112 ceph-mon[32322]: pgmap v334: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:47:32.481 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:33 smithi043 ceph-mon[29167]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T20:47:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:33 smithi195 ceph-mon[33250]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T20:47:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:33 smithi112 ceph-mon[32322]: pgmap v335: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-04-25T20:47:36.049 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:36.136 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:35 smithi043 ceph-mon[29167]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T20:47:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:35 smithi195 ceph-mon[33250]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T20:47:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:35 smithi112 ceph-mon[32322]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-25T20:47:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:37 smithi043 ceph-mon[29167]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-04-25T20:47:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:37 smithi195 ceph-mon[33250]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-04-25T20:47:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:37 smithi112 ceph-mon[32322]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-04-25T20:47:38.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 -- 172.21.15.43:0/733972824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 msgr2=0x7ffb84101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 --2- 172.21.15.43:0/733972824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb84101dc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009990 tx=0x7ffb78009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 -- 172.21.15.43:0/733972824 shutdown_connections 2024-04-25T20:47:38.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 --2- 172.21.15.43:0/733972824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 0x7ffb84107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 --2- 172.21.15.43:0/733972824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb84102300 0x7ffb8410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 --2- 172.21.15.43:0/733972824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb84101dc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 -- 172.21.15.43:0/733972824 >> 172.21.15.43:0/733972824 conn(0x7ffb840788f0 msgr2=0x7ffb84078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 -- 172.21.15.43:0/733972824 shutdown_connections 2024-04-25T20:47:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.710+0000 7ffb8befa700 1 -- 172.21.15.43:0/733972824 wait complete. 2024-04-25T20:47:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 Processor -- start 2024-04-25T20:47:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 -- start start 2024-04-25T20:47:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb841034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb84102300 0x7ffb84103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 0x7ffb84103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffb84111c70 con 0x7ffb84101940 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffb84111af0 con 0x7ffb84102300 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb8befa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffb84111df0 con 0x7ffb84107990 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb89c96700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb841034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb89c96700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb841034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44814/0 (socket says 172.21.15.43:44814) 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.711+0000 7ffb89c96700 1 -- 172.21.15.43:0/2921588193 learned_addr learned my addr 172.21.15.43:0/2921588193 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb8a497700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 0x7ffb84103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89495700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb84102300 0x7ffb84103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 -- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 msgr2=0x7ffb84103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 0x7ffb84103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 -- 172.21.15.43:0/2921588193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb84102300 msgr2=0x7ffb84103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffb84102300 0x7ffb84103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb841a7780 con 0x7ffb84101940 2024-04-25T20:47:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb8a497700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb84107990 0x7ffb84103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb89c96700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb841034f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000c970 tx=0x7ffb8000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80007aa0 con 0x7ffb84101940 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb80004d00 con 0x7ffb84101940 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb8befa700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb841a7a70 con 0x7ffb84101940 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80005670 con 0x7ffb84101940 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.712+0000 7ffb8befa700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb841a7f60 con 0x7ffb84101940 2024-04-25T20:47:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.713+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb6c001030 con 0x7ffb84101940 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.714+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ffb80007cd0 con 0x7ffb84101940 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb76ffd700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ffb700a3cd0 0x7ffb700a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb89495700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ffb700a3cd0 0x7ffb700a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7ffb800d08e0 con 0x7ffb84101940 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb76ffd700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] conn(0x7ffb700ad810 0x7ffb700afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb8000de50 con 0x7ffb700ad810 2024-04-25T20:47:38.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.715+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7ffb800d0d30 con 0x7ffb84101940 2024-04-25T20:47:38.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.716+0000 7ffb89495700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ffb700a3cd0 0x7ffb700a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb78006010 tx=0x7ffb7800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:38.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.716+0000 7ffb8a497700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] conn(0x7ffb700ad810 0x7ffb700afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:38.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.716+0000 7ffb8a497700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] conn(0x7ffb700ad810 0x7ffb700afcb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:38.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.717+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== osd.5 v2:172.21.15.195:6808/280629682 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb8000de50 con 0x7ffb700ad810 2024-04-25T20:47:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.734+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 --> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb6c002e60 con 0x7ffb700ad810 2024-04-25T20:47:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.734+0000 7ffb76ffd700 1 -- 172.21.15.43:0/2921588193 <== osd.5 v2:172.21.15.195:6808/280629682 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffb6c002e60 con 0x7ffb700ad810 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] conn(0x7ffb700ad810 msgr2=0x7ffb700afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] conn(0x7ffb700ad810 0x7ffb700afcb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ffb700a3cd0 msgr2=0x7ffb700a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ffb700a3cd0 0x7ffb700a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb78006010 tx=0x7ffb7800b540 comp rx=0 tx=0).stop 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 msgr2=0x7ffb841034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 --2- 172.21.15.43:0/2921588193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb84101940 0x7ffb841034f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000c970 tx=0x7ffb8000cd30 comp rx=0 tx=0).stop 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb8a497700 1 -- 172.21.15.43:0/2921588193 reap_dead start 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 shutdown_connections 2024-04-25T20:47:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 >> 172.21.15.43:0/2921588193 conn(0x7ffb840788f0 msgr2=0x7ffb8406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 shutdown_connections 2024-04-25T20:47:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:38.735+0000 7ffb74ff9700 1 -- 172.21.15.43:0/2921588193 wait complete. 2024-04-25T20:47:40.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:39 smithi043 ceph-mon[29167]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:39 smithi195 ceph-mon[33250]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:39 smithi112 ceph-mon[32322]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:41.986 INFO:teuthology.orchestra.run.smithi043.stdout:167503724606 2024-04-25T20:47:41.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T20:47:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:41 smithi043 ceph-mon[29167]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:41 smithi195 ceph-mon[33250]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:41 smithi112 ceph-mon[32322]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:44.159 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:43 smithi043 ceph-mon[29167]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:47:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:43 smithi195 ceph-mon[33250]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:47:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:43 smithi112 ceph-mon[32322]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/1645117465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8074c70 msgr2=0x7fe4d8075050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/1645117465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8074c70 0x7fe4d8075050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009990 tx=0x7fe4d4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/1645117465 shutdown_connections 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/1645117465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 0x7fe4d8111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/1645117465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8074c70 0x7fe4d8075050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/1645117465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8075590 0x7fe4d810ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/1645117465 >> 172.21.15.43:0/1645117465 conn(0x7fe4d8079bb0 msgr2=0x7fe4d8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/1645117465 shutdown_connections 2024-04-25T20:47:44.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.367+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/1645117465 wait complete. 2024-04-25T20:47:44.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 Processor -- start 2024-04-25T20:47:44.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 -- start start 2024-04-25T20:47:44.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8074c70 0x7fe4d819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 0x7fe4d819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 0x7fe4d819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8115000 con 0x7fe4d8075590 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8114e80 con 0x7fe4d8074c70 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dfb1a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8115180 con 0x7fe4d810f470 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 0x7fe4d819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 0x7fe4d819b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44836/0 (socket says 172.21.15.43:44836) 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 -- 172.21.15.43:0/3110113122 learned_addr learned my addr 172.21.15.43:0/3110113122 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd8b6700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8074c70 0x7fe4d819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4de0b7700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 0x7fe4d819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 -- 172.21.15.43:0/3110113122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 msgr2=0x7fe4d819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 0x7fe4d819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 -- 172.21.15.43:0/3110113122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8074c70 msgr2=0x7fe4d819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8074c70 0x7fe4d819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd0b5700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d81a03d0 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4de0b7700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe4d810f470 0x7fe4d819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.368+0000 7fe4dd8b6700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d8074c70 0x7fe4d819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4dd0b5700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 0x7fe4d819b950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b500 tx=0x7fe4c800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8015020 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4c8011d00 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d81a06c0 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8010e10 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.369+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d81a7f40 con 0x7fe4d8075590 2024-04-25T20:47:44.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.370+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4d81005e0 con 0x7fe4d8075590 2024-04-25T20:47:44.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.371+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe4c8018020 con 0x7fe4d8075590 2024-04-25T20:47:44.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.371+0000 7fe4ceffd700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4c40a3cd0 0x7fe4c40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:44.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4dd8b6700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4c40a3cd0 0x7fe4c40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe4c80d03c0 con 0x7fe4d8075590 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4ceffd700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] conn(0x7fe4c40ad810 0x7fe4c40afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4c40b0380 con 0x7fe4c40ad810 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fe4c80d0810 con 0x7fe4d8075590 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4de0b7700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] conn(0x7fe4c40ad810 0x7fe4c40afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4dd8b6700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4c40a3cd0 0x7fe4c40a6190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4006010 tx=0x7fe4d400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.372+0000 7fe4de0b7700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] conn(0x7fe4c40ad810 0x7fe4c40afcb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:44.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.373+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== osd.6 v2:172.21.15.43:6818/1789482351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4c40b0380 con 0x7fe4c40ad810 2024-04-25T20:47:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.389+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 --> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4d8076360 con 0x7fe4c40ad810 2024-04-25T20:47:44.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.389+0000 7fe4ceffd700 1 -- 172.21.15.43:0/3110113122 <== osd.6 v2:172.21.15.43:6818/1789482351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe4d8076360 con 0x7fe4c40ad810 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] conn(0x7fe4c40ad810 msgr2=0x7fe4c40afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] conn(0x7fe4c40ad810 0x7fe4c40afcb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4c40a3cd0 msgr2=0x7fe4c40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4c40a3cd0 0x7fe4c40a6190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4006010 tx=0x7fe4d400b540 comp rx=0 tx=0).stop 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 msgr2=0x7fe4d819b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 --2- 172.21.15.43:0/3110113122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d8075590 0x7fe4d819b950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b500 tx=0x7fe4c800b8c0 comp rx=0 tx=0).stop 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4de0b7700 1 -- 172.21.15.43:0/3110113122 reap_dead start 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 shutdown_connections 2024-04-25T20:47:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 >> 172.21.15.43:0/3110113122 conn(0x7fe4d8079bb0 msgr2=0x7fe4d80ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 shutdown_connections 2024-04-25T20:47:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:44.390+0000 7fe4dfb1a700 1 -- 172.21.15.43:0/3110113122 wait complete. 2024-04-25T20:47:44.880 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- 172.21.15.43:0/3658957244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1054b0 msgr2=0x7fb60c105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 --2- 172.21.15.43:0/3658957244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1054b0 0x7fb60c105910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb60400b0a0 tx=0x7fb60400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- 172.21.15.43:0/3658957244 shutdown_connections 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 --2- 172.21.15.43:0/3658957244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb60c1079a0 0x7fb60c06b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 --2- 172.21.15.43:0/3658957244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1054b0 0x7fb60c105910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 --2- 172.21.15.43:0/3658957244 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c06b730 0x7fb60c06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- 172.21.15.43:0/3658957244 >> 172.21.15.43:0/3658957244 conn(0x7fb60c0789e0 msgr2=0x7fb60c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- 172.21.15.43:0/3658957244 shutdown_connections 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- 172.21.15.43:0/3658957244 wait complete. 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 Processor -- start 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.973+0000 7fb6139fe700 1 -- start start 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb60c06b730 0x7fb60c1a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c1054b0 0x7fb60c1a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 0x7fb60c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c119370 con 0x7fb60c1079a0 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1191f0 con 0x7fb60c1054b0 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb6139fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c1194f0 con 0x7fb60c06b730 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 0x7fb60c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 0x7fb60c19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32848/0 (socket says 172.21.15.43:32848) 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 -- 172.21.15.43:0/2112382692 learned_addr learned my addr 172.21.15.43:0/2112382692 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb61179a700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb60c06b730 0x7fb60c1a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb610f99700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c1054b0 0x7fb60c1a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 -- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb60c06b730 msgr2=0x7fb60c1a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb60c06b730 0x7fb60c1a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 -- 172.21.15.43:0/2112382692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c1054b0 msgr2=0x7fb60c1a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c1054b0 0x7fb60c1a5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c19fd10 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb610f99700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb60c1054b0 0x7fb60c1a5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.974+0000 7fb611f9b700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 0x7fb60c19f5b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb604006130 tx=0x7fb604007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604021070 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb60401db20 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c19ffa0 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60401bb50 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c1ac2c0 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.975+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb60c104ef0 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.977+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb604024070 con 0x7fb60c1079a0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.977+0000 7fb6027fc700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5f80a3cd0 0x7fb5f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.977+0000 7fb61179a700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5f80a3cd0 0x7fb5f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.978+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb60400f020 con 0x7fb60c1079a0 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.978+0000 7fb6027fc700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] conn(0x7fb5f80ad810 0x7fb5f80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.978+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb60400aea0 con 0x7fb5f80ad810 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.978+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb6040d2820 con 0x7fb60c1079a0 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.978+0000 7fb61179a700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5f80a3cd0 0x7fb5f80a6190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb608005950 tx=0x7fb60800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.979+0000 7fb610f99700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] conn(0x7fb5f80ad810 0x7fb5f80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.979+0000 7fb610f99700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] conn(0x7fb5f80ad810 0x7fb5f80afcb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.980+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== osd.11 v2:172.21.15.195:6824/1436610024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb60400aea0 con 0x7fb5f80ad810 2024-04-25T20:47:45.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.996+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 --> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb60c101f90 con 0x7fb5f80ad810 2024-04-25T20:47:45.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.997+0000 7fb6027fc700 1 -- 172.21.15.43:0/2112382692 <== osd.11 v2:172.21.15.195:6824/1436610024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb60c101f90 con 0x7fb5f80ad810 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] conn(0x7fb5f80ad810 msgr2=0x7fb5f80afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] conn(0x7fb5f80ad810 0x7fb5f80afcb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5f80a3cd0 msgr2=0x7fb5f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb5f80a3cd0 0x7fb5f80a6190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb608005950 tx=0x7fb60800a300 comp rx=0 tx=0).stop 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 msgr2=0x7fb60c19f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 --2- 172.21.15.43:0/2112382692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb60c1079a0 0x7fb60c19f5b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb604006130 tx=0x7fb604007a20 comp rx=0 tx=0).stop 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb611f9b700 1 -- 172.21.15.43:0/2112382692 reap_dead start 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 shutdown_connections 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 >> 172.21.15.43:0/2112382692 conn(0x7fb60c0789e0 msgr2=0x7fb60c104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 shutdown_connections 2024-04-25T20:47:45.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:45.998+0000 7fb6139fe700 1 -- 172.21.15.43:0/2112382692 wait complete. 2024-04-25T20:47:46.144 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:45 smithi195 ceph-mon[33250]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:46.189 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:45 smithi043 ceph-mon[29167]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:45 smithi112 ceph-mon[32322]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:48.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 -- 172.21.15.43:0/628637526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c06bbb0 msgr2=0x7f685c10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 --2- 172.21.15.43:0/628637526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c06bbb0 0x7f685c10f930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f685400b0a0 tx=0x7f685400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 -- 172.21.15.43:0/628637526 shutdown_connections 2024-04-25T20:47:48.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 --2- 172.21.15.43:0/628637526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c108a60 0x7f685c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 --2- 172.21.15.43:0/628637526 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c06bbb0 0x7f685c10f930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 --2- 172.21.15.43:0/628637526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f685c06b1f0 0x7f685c06b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 -- 172.21.15.43:0/628637526 >> 172.21.15.43:0/628637526 conn(0x7f685c0789e0 msgr2=0x7f685c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 -- 172.21.15.43:0/628637526 shutdown_connections 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.189+0000 7f68628fe700 1 -- 172.21.15.43:0/628637526 wait complete. 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 Processor -- start 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 -- start start 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c06b1f0 0x7f685c1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f685c06bbb0 0x7f685c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 0x7f685c19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f685c112d60 con 0x7f685c108a60 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f685c112be0 con 0x7f685c06bbb0 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f68628fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f685c112ee0 con 0x7f685c06b1f0 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f6860e9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 0x7f685c19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f6860e9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 0x7f685c19d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32870/0 (socket says 172.21.15.43:32870) 2024-04-25T20:47:48.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f6860e9b700 1 -- 172.21.15.43:0/570662781 learned_addr learned my addr 172.21.15.43:0/570662781 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.190+0000 7f685b7fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f685c06bbb0 0x7f685c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 -- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c06b1f0 msgr2=0x7f685c1990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f685c06b1f0 0x7f685c1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 -- 172.21.15.43:0/570662781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f685c06bbb0 msgr2=0x7f685c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f685c06bbb0 0x7f685c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685c19e100 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f6860e9b700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 0x7f685c19d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f685400b070 tx=0x7f6854007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854021070 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685c19e390 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f685401db20 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685401bb50 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.191+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f685c1a5c70 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.192+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f685c1002b0 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.193+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6854024070 con 0x7f685c108a60 2024-04-25T20:47:48.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f68597fa700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f68480a3cd0 0x7f68480a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f685bfff700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f68480a3cd0 0x7f68480a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f685400f020 con 0x7f685c108a60 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f68597fa700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] conn(0x7f68480ad810 0x7f68480afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68480b0380 con 0x7f68480ad810 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f68540d2500 con 0x7f685c108a60 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f685bfff700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f68480a3cd0 0x7f68480a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f684400a9b0 tx=0x7f6844005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.194+0000 7f685b7fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] conn(0x7f68480ad810 0x7f68480afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.195+0000 7f685b7fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] conn(0x7f68480ad810 0x7f68480afcb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.196+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== osd.8 v2:172.21.15.195:6816/81594991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68480b0380 con 0x7f68480ad810 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.212+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 --> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f685c1041a0 con 0x7f68480ad810 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68597fa700 1 -- 172.21.15.43:0/570662781 <== osd.8 v2:172.21.15.195:6816/81594991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f685c1041a0 con 0x7f68480ad810 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] conn(0x7f68480ad810 msgr2=0x7f68480afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] conn(0x7f68480ad810 0x7f68480afcb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f68480a3cd0 msgr2=0x7f68480a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f68480a3cd0 0x7f68480a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f684400a9b0 tx=0x7f6844005c90 comp rx=0 tx=0).stop 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 msgr2=0x7f685c19d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 --2- 172.21.15.43:0/570662781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f685c108a60 0x7f685c19d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f685400b070 tx=0x7f6854007a20 comp rx=0 tx=0).stop 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f6860e9b700 1 -- 172.21.15.43:0/570662781 reap_dead start 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 shutdown_connections 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 >> 172.21.15.43:0/570662781 conn(0x7f685c0789e0 msgr2=0x7f685c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 shutdown_connections 2024-04-25T20:47:48.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:46.213+0000 7f68628fe700 1 -- 172.21.15.43:0/570662781 wait complete. 2024-04-25T20:47:48.116 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:47 smithi043 ceph-mon[29167]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-25T20:47:48.145 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:47 smithi112 ceph-mon[32322]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-25T20:47:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:47 smithi195 ceph-mon[33250]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-04-25T20:47:48.716 INFO:teuthology.orchestra.run.smithi043.stdout:257698037807 2024-04-25T20:47:48.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 -- 172.21.15.43:0/1230556427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 msgr2=0x7f5434102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 --2- 172.21.15.43:0/1230556427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434102f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5420009990 tx=0x7f5420009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 -- 172.21.15.43:0/1230556427 shutdown_connections 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 --2- 172.21.15.43:0/1230556427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 0x7f5434108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 --2- 172.21.15.43:0/1230556427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 0x7f543410f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 --2- 172.21.15.43:0/1230556427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434102f20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 -- 172.21.15.43:0/1230556427 >> 172.21.15.43:0/1230556427 conn(0x7f5434079b10 msgr2=0x7f5434079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 -- 172.21.15.43:0/1230556427 shutdown_connections 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.899+0000 7f543b216700 1 -- 172.21.15.43:0/1230556427 wait complete. 2024-04-25T20:47:48.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 Processor -- start 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 -- start start 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 0x7f5434075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 0x7f54340757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5434112e30 con 0x7f5434102ac0 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5434112cb0 con 0x7f5434103460 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f543b216700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5434112fb0 con 0x7f5434108a70 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f5438fb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f5438fb2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32876/0 (socket says 172.21.15.43:32876) 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f5438fb2700 1 -- 172.21.15.43:0/2080636687 learned_addr learned my addr 172.21.15.43:0/2080636687 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f5433fff700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 0x7f5434075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.900+0000 7f54397b3700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 0x7f54340757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 -- 172.21.15.43:0/2080636687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 msgr2=0x7f54340757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 0x7f54340757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 -- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 msgr2=0x7f5434075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 0x7f5434075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54341a7890 con 0x7f5434102ac0 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5433fff700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5434103460 0x7f5434075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f54397b3700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5434108a70 0x7f54340757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5438fb2700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434074d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f542800b530 tx=0x7f542800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428015020 con 0x7f5434102ac0 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54341a7b80 con 0x7f5434102ac0 2024-04-25T20:47:48.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5428011d00 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428010e60 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.901+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54341a8070 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.902+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5434063110 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.903+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5428018020 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5431ffb700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f54240a3cd0 0x7f54240a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f54280d0430 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5433fff700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f54240a3cd0 0x7f54240a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5431ffb700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] conn(0x7f54240ad810 0x7f54240afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54240b0380 con 0x7f54240ad810 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.904+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f54280d07e0 con 0x7f5434102ac0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.905+0000 7f54397b3700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] conn(0x7f54240ad810 0x7f54240afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.905+0000 7f5433fff700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f54240a3cd0 0x7f54240a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5420006010 tx=0x7f542000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.905+0000 7f54397b3700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] conn(0x7f54240ad810 0x7f54240afcb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.906+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== osd.4 v2:172.21.15.112:6808/429665117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54240b0380 con 0x7f54240ad810 2024-04-25T20:47:48.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.923+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 --> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5434063510 con 0x7f54240ad810 2024-04-25T20:47:48.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.923+0000 7f5431ffb700 1 -- 172.21.15.43:0/2080636687 <== osd.4 v2:172.21.15.112:6808/429665117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5434063510 con 0x7f54240ad810 2024-04-25T20:47:48.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] conn(0x7f54240ad810 msgr2=0x7f54240afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] conn(0x7f54240ad810 0x7f54240afcb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f54240a3cd0 msgr2=0x7f54240a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f54240a3cd0 0x7f54240a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5420006010 tx=0x7f542000b540 comp rx=0 tx=0).stop 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 msgr2=0x7f5434074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 --2- 172.21.15.43:0/2080636687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5434102ac0 0x7f5434074d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f542800b530 tx=0x7f542800b8f0 comp rx=0 tx=0).stop 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f54397b3700 1 -- 172.21.15.43:0/2080636687 reap_dead start 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 shutdown_connections 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 >> 172.21.15.43:0/2080636687 conn(0x7f5434079b10 msgr2=0x7f5434100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 shutdown_connections 2024-04-25T20:47:48.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:48.924+0000 7f543b216700 1 -- 172.21.15.43:0/2080636687 wait complete. 2024-04-25T20:47:49.977 INFO:teuthology.orchestra.run.smithi043.stdout:201863462969 2024-04-25T20:47:49.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-25T20:47:50.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:49 smithi043 ceph-mon[29167]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:49 smithi195 ceph-mon[33250]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:49 smithi112 ceph-mon[32322]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:50.743 INFO:teuthology.orchestra.run.smithi043.stdout:146028888132 2024-04-25T20:47:50.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T20:47:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 -- 172.21.15.43:0/1024929780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 msgr2=0x7fbe0c06ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 --2- 172.21.15.43:0/1024929780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c06ab30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00b0a0 tx=0x7fbdfc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 -- 172.21.15.43:0/1024929780 shutdown_connections 2024-04-25T20:47:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 --2- 172.21.15.43:0/1024929780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c10f4f0 0x7fbe0c1118e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 --2- 172.21.15.43:0/1024929780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c06ab30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 --2- 172.21.15.43:0/1024929780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe0c06b070 0x7fbe0c10efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 -- 172.21.15.43:0/1024929780 >> 172.21.15.43:0/1024929780 conn(0x7fbe0c0788f0 msgr2=0x7fbe0c078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:51.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 -- 172.21.15.43:0/1024929780 shutdown_connections 2024-04-25T20:47:51.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.058+0000 7fbe12174700 1 -- 172.21.15.43:0/1024929780 wait complete. 2024-04-25T20:47:51.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 Processor -- start 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 -- start start 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c06b070 0x7fbe0c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe0c10f4f0 0x7fbe0c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c114f40 con 0x7fbe0c06a750 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c114dc0 con 0x7fbe0c10f4f0 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe12174700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1150c0 con 0x7fbe0c06b070 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe0b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe0b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c19b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32912/0 (socket says 172.21.15.43:32912) 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.059+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2909727107 learned_addr learned my addr 172.21.15.43:0/2909727107 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c06b070 0x7fbe0c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2909727107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c06b070 msgr2=0x7fbe0c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c06b070 0x7fbe0c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe0c10f4f0 0x7fbe0c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2909727107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe0c10f4f0 msgr2=0x7fbe0c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe0c10f4f0 0x7fbe0c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c1a03b0 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe0c06b070 0x7fbe0c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c19b3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0062a0 tx=0x7fbdfc007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc021070 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdfc007e30 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c1a0640 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc01bcf0 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.060+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1a7f20 con 0x7fbe0c06a750 2024-04-25T20:47:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.061+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe0c063110 con 0x7fbe0c06a750 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.062+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbdfc024070 con 0x7fbe0c06a750 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe08ff9700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fbdf80a3cd0 0x7fbdf80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fbdf80a3cd0 0x7fbdf80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fbdfc00f020 con 0x7fbe0c06a750 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe08ff9700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] conn(0x7fbdf80ad810 0x7fbdf80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdfc0020b0 con 0x7fbdf80ad810 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fbdfc0d1df0 con 0x7fbe0c06a750 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fbdf80a3cd0 0x7fbdf80a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005fd0 tx=0x7fbdf4005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.063+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] conn(0x7fbdf80ad810 0x7fbdf80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.064+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] conn(0x7fbdf80ad810 0x7fbdf80afcb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.064+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== osd.0 v2:172.21.15.43:6802/1217576324 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbdfc0020b0 con 0x7fbdf80ad810 2024-04-25T20:47:51.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 --> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe0c063590 con 0x7fbdf80ad810 2024-04-25T20:47:51.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe08ff9700 1 -- 172.21.15.43:0/2909727107 <== osd.0 v2:172.21.15.43:6802/1217576324 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe0c063590 con 0x7fbdf80ad810 2024-04-25T20:47:51.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] conn(0x7fbdf80ad810 msgr2=0x7fbdf80afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] conn(0x7fbdf80ad810 0x7fbdf80afcb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fbdf80a3cd0 msgr2=0x7fbdf80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fbdf80a3cd0 0x7fbdf80a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005fd0 tx=0x7fbdf4005e20 comp rx=0 tx=0).stop 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 msgr2=0x7fbe0c19b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe12174700 1 --2- 172.21.15.43:0/2909727107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06a750 0x7fbe0c19b3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0062a0 tx=0x7fbdfc007ad0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.081+0000 7fbe0bfff700 1 -- 172.21.15.43:0/2909727107 reap_dead start 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.082+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 shutdown_connections 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.082+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 >> 172.21.15.43:0/2909727107 conn(0x7fbe0c0788f0 msgr2=0x7fbe0c1108e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.082+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 shutdown_connections 2024-04-25T20:47:51.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.082+0000 7fbe12174700 1 -- 172.21.15.43:0/2909727107 wait complete. 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/628341806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 msgr2=0x7f9acc10e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/628341806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc10e7f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400b0a0 tx=0x7f9ac400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/628341806 shutdown_connections 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/628341806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc10e7f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/628341806 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc107990 0x7f9acc107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/628341806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 0x7f9acc101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/628341806 >> 172.21.15.43:0/628341806 conn(0x7f9acc0788f0 msgr2=0x7f9acc078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/628341806 shutdown_connections 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.265+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/628341806 wait complete. 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 Processor -- start 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 -- start start 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 0x7f9acc1034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc107990 0x7f9acc103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc111c70 con 0x7f9acc102300 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc111af0 con 0x7f9acc107990 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad2e4d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc111df0 con 0x7f9acc101940 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9acbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9acbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc103a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32922/0 (socket says 172.21.15.43:32922) 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9acbfff700 1 -- 172.21.15.43:0/2084758156 learned_addr learned my addr 172.21.15.43:0/2084758156 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad0be9700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 0x7f9acc1034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.266+0000 7f9ad13ea700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc107990 0x7f9acc103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 -- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 msgr2=0x7f9acc1034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 0x7f9acc1034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 -- 172.21.15.43:0/2084758156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc107990 msgr2=0x7f9acc103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9acc107990 0x7f9acc103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc1a76a0 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ad0be9700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9acc101940 0x7f9acc1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9acbfff700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc103a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800d980 tx=0x7f9ab800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8016070 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ab8004d00 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc1a7990 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8005610 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.267+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1a7ed0 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.268+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9acc1058c0 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.270+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9ab8004750 con 0x7f9acc102300 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.270+0000 7f9ac9ffb700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9abc0a3cd0 0x7f9abc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.270+0000 7f9ad0be9700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9abc0a3cd0 0x7f9abc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.270+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f9ab80d0a10 con 0x7f9acc102300 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ac9ffb700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] conn(0x7f9abc0ad810 0x7f9abc0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ab8015ec0 con 0x7f9abc0ad810 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9ab80d0e60 con 0x7f9acc102300 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ad0be9700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9abc0a3cd0 0x7f9abc0a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009c90 tx=0x7f9ac0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ad13ea700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] conn(0x7f9abc0ad810 0x7f9abc0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.271+0000 7f9ad13ea700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] conn(0x7f9abc0ad810 0x7f9abc0afcb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.272+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== osd.2 v2:172.21.15.195:6800/2000658150 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ab8015ec0 con 0x7f9abc0ad810 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.289+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 --> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9acc103060 con 0x7f9abc0ad810 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.289+0000 7f9ac9ffb700 1 -- 172.21.15.43:0/2084758156 <== osd.2 v2:172.21.15.195:6800/2000658150 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9acc103060 con 0x7f9abc0ad810 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] conn(0x7f9abc0ad810 msgr2=0x7f9abc0afcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] conn(0x7f9abc0ad810 0x7f9abc0afcb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9abc0a3cd0 msgr2=0x7f9abc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9abc0a3cd0 0x7f9abc0a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009c90 tx=0x7f9ac0009260 comp rx=0 tx=0).stop 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 msgr2=0x7f9acc103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 --2- 172.21.15.43:0/2084758156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9acc102300 0x7f9acc103a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800d980 tx=0x7f9ab800dc90 comp rx=0 tx=0).stop 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad13ea700 1 -- 172.21.15.43:0/2084758156 reap_dead start 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 shutdown_connections 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 >> 172.21.15.43:0/2084758156 conn(0x7f9acc0788f0 msgr2=0x7f9acc100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 shutdown_connections 2024-04-25T20:47:51.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:51.290+0000 7f9ad2e4d700 1 -- 172.21.15.43:0/2084758156 wait complete. 2024-04-25T20:47:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:51 smithi043 ceph-mon[29167]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:51 smithi195 ceph-mon[33250]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:51 smithi112 ceph-mon[32322]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:47:52.427 INFO:teuthology.orchestra.run.smithi043.stdout:34359738457 2024-04-25T20:47:52.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T20:47:52.986 INFO:teuthology.orchestra.run.smithi043.stdout:77309411408 2024-04-25T20:47:52.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T20:47:53.690 INFO:teuthology.orchestra.run.smithi043.stdout:347892351008 2024-04-25T20:47:53.690 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.949+0000 7f45d5724700 1 -- 172.21.15.43:0/3433155757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 msgr2=0x7f45d010f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.949+0000 7f45d5724700 1 --2- 172.21.15.43:0/3433155757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d010f8d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f45c800b0a0 tx=0x7f45c800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 -- 172.21.15.43:0/3433155757 shutdown_connections 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 --2- 172.21.15.43:0/3433155757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d010f8d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 --2- 172.21.15.43:0/3433155757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0108a70 0x7f45d0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 --2- 172.21.15.43:0/3433155757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d0102ac0 0x7f45d0102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 -- 172.21.15.43:0/3433155757 >> 172.21.15.43:0/3433155757 conn(0x7f45d0079bb0 msgr2=0x7f45d0079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 -- 172.21.15.43:0/3433155757 shutdown_connections 2024-04-25T20:47:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 -- 172.21.15.43:0/3433155757 wait complete. 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 Processor -- start 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.950+0000 7f45d5724700 1 -- start start 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0102ac0 0x7f45d0199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d01995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d0108a70 0x7f45d019d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112dc0 con 0x7f45d0103480 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112c40 con 0x7f45d0102ac0 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45d5724700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112f40 con 0x7f45d0108a70 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d01995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d01995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32892/0 (socket says 172.21.15.43:32892) 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 -- 172.21.15.43:0/3873702344 learned_addr learned my addr 172.21.15.43:0/3873702344 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45cf7fe700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d0108a70 0x7f45d019d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45ceffd700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0102ac0 0x7f45d0199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 -- 172.21.15.43:0/3873702344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d0108a70 msgr2=0x7f45d019d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45d0108a70 0x7f45d019d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 -- 172.21.15.43:0/3873702344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0102ac0 msgr2=0x7f45d0199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0102ac0 0x7f45d0199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45c67fc700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d019e0a0 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.951+0000 7f45ceffd700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f45d0102ac0 0x7f45d0199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45c67fc700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d01995d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f45b800c9b0 tx=0x7f45b800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8007b00 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d019e390 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f45b8007ca0 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a5c10 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.952+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8018640 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.953+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45b0001030 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.954+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f45b80188a0 con 0x7f45d0103480 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ccff9700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f45bc0a3d50 0x7f45bc0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ceffd700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f45bc0a3d50 0x7f45bc0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f45b80d09c0 con 0x7f45d0103480 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ccff9700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] conn(0x7f45bc0ad890 0x7f45bc0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45b800eec0 con 0x7f45bc0ad890 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.955+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f45b80d0e10 con 0x7f45d0103480 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.956+0000 7f45cf7fe700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] conn(0x7f45bc0ad890 0x7f45bc0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.956+0000 7f45ceffd700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f45bc0a3d50 0x7f45bc0a6210 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009c90 tx=0x7f45c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.956+0000 7f45cf7fe700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] conn(0x7f45bc0ad890 0x7f45bc0afd30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.957+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== osd.9 v2:172.21.15.43:6826/309263897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45b800eec0 con 0x7f45bc0ad890 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.973+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 --> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45b0002e60 con 0x7f45bc0ad890 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45ccff9700 1 -- 172.21.15.43:0/3873702344 <== osd.9 v2:172.21.15.43:6826/309263897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45b0002e60 con 0x7f45bc0ad890 2024-04-25T20:47:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] conn(0x7f45bc0ad890 msgr2=0x7f45bc0afd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] conn(0x7f45bc0ad890 0x7f45bc0afd30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f45bc0a3d50 msgr2=0x7f45bc0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f45bc0a3d50 0x7f45bc0a6210 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009c90 tx=0x7f45c0009260 comp rx=0 tx=0).stop 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 msgr2=0x7f45d01995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 --2- 172.21.15.43:0/3873702344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d0103480 0x7f45d01995d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f45b800c9b0 tx=0x7f45b800ccc0 comp rx=0 tx=0).stop 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45cf7fe700 1 -- 172.21.15.43:0/3873702344 reap_dead start 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 shutdown_connections 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 >> 172.21.15.43:0/3873702344 conn(0x7f45d0079bb0 msgr2=0x7f45d0101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 shutdown_connections 2024-04-25T20:47:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:50.974+0000 7f45d5724700 1 -- 172.21.15.43:0/3873702344 wait complete. 2024-04-25T20:47:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:53 smithi043 ceph-mon[29167]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-25T20:47:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:53 smithi195 ceph-mon[33250]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-25T20:47:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:53 smithi112 ceph-mon[32322]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-25T20:47:54.523 INFO:teuthology.orchestra.run.smithi043.stdout:292057776172 2024-04-25T20:47:54.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-25T20:47:55.449 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 -- 172.21.15.43:0/2890031133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c101940 msgr2=0x7fdd7c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 --2- 172.21.15.43:0/2890031133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c101940 0x7fdd7c101dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009990 tx=0x7fdd68009ca0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 -- 172.21.15.43:0/2890031133 shutdown_connections 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 --2- 172.21.15.43:0/2890031133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 0x7fdd7c107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 --2- 172.21.15.43:0/2890031133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c102300 0x7fdd7c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 --2- 172.21.15.43:0/2890031133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c101940 0x7fdd7c101dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 -- 172.21.15.43:0/2890031133 >> 172.21.15.43:0/2890031133 conn(0x7fdd7c0788f0 msgr2=0x7fdd7c078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 -- 172.21.15.43:0/2890031133 shutdown_connections 2024-04-25T20:47:55.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.462+0000 7fdd83020700 1 -- 172.21.15.43:0/2890031133 wait complete. 2024-04-25T20:47:55.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.463+0000 7fdd83020700 1 Processor -- start 2024-04-25T20:47:55.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.463+0000 7fdd83020700 1 -- start start 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c101940 0x7fdd7c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 0x7fdd7c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 0x7fdd7c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c111c70 con 0x7fdd7c102300 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c111af0 con 0x7fdd7c101940 2024-04-25T20:47:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd83020700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c111df0 con 0x7fdd7c107990 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 0x7fdd7c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 0x7fdd7c1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32942/0 (socket says 172.21.15.43:32942) 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd7bfff700 1 -- 172.21.15.43:0/2442388911 learned_addr learned my addr 172.21.15.43:0/2442388911 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd80dbc700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c101940 0x7fdd7c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd815bd700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 0x7fdd7c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd80dbc700 1 -- 172.21.15.43:0/2442388911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 msgr2=0x7fdd7c19da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd80dbc700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 0x7fdd7c19da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.464+0000 7fdd80dbc700 1 -- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 msgr2=0x7fdd7c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd80dbc700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 0x7fdd7c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd80dbc700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c19e170 con 0x7fdd7c101940 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd815bd700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd7c107990 0x7fdd7c19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd7bfff700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd7c102300 0x7fdd7c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:47:55.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd80dbc700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c101940 0x7fdd7c1991b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c970 tx=0x7fdd7000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000e880 con 0x7fdd7c101940 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd7000f450 con 0x7fdd7c101940 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.465+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70018660 con 0x7fdd7c101940 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.466+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c19e460 con 0x7fdd7c101940 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.466+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c103420 con 0x7fdd7c101940 2024-04-25T20:47:55.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.467+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd7c0631d0 con 0x7fdd7c101940 2024-04-25T20:47:55.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.468+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdd7000f9b0 con 0x7fdd7c101940 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.469+0000 7fdd79ffb700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdd6c0a3e20 0x7fdd6c0a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.469+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fdd700d07d0 con 0x7fdd7c101940 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.469+0000 7fdd79ffb700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] conn(0x7fdd6c0ad960 0x7fdd6c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.469+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd70015e70 con 0x7fdd6c0ad960 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.469+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fdd700d0c20 con 0x7fdd7c101940 2024-04-25T20:47:55.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.470+0000 7fdd7bfff700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdd6c0a3e20 0x7fdd6c0a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:55.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.470+0000 7fdd815bd700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] conn(0x7fdd6c0ad960 0x7fdd6c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:55.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.470+0000 7fdd7bfff700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdd6c0a3e20 0x7fdd6c0a62e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c078df0 tx=0x7fdd68009630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:55.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.471+0000 7fdd815bd700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] conn(0x7fdd6c0ad960 0x7fdd6c0afe00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:55.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.472+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== osd.7 v2:172.21.15.112:6816/3123103723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd70015e70 con 0x7fdd6c0ad960 2024-04-25T20:47:55.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.493+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 --> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd7c063650 con 0x7fdd6c0ad960 2024-04-25T20:47:55.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.493+0000 7fdd79ffb700 1 -- 172.21.15.43:0/2442388911 <== osd.7 v2:172.21.15.112:6816/3123103723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdd7c063650 con 0x7fdd6c0ad960 2024-04-25T20:47:55.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.493+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] conn(0x7fdd6c0ad960 msgr2=0x7fdd6c0afe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.493+0000 7fdd83020700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] conn(0x7fdd6c0ad960 0x7fdd6c0afe00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdd6c0a3e20 msgr2=0x7fdd6c0a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fdd6c0a3e20 0x7fdd6c0a62e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c078df0 tx=0x7fdd68009630 comp rx=0 tx=0).stop 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c101940 msgr2=0x7fdd7c1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 --2- 172.21.15.43:0/2442388911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd7c101940 0x7fdd7c1991b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c970 tx=0x7fdd7000cc80 comp rx=0 tx=0).stop 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd815bd700 1 -- 172.21.15.43:0/2442388911 reap_dead start 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 shutdown_connections 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 >> 172.21.15.43:0/2442388911 conn(0x7fdd7c0788f0 msgr2=0x7fdd7c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 shutdown_connections 2024-04-25T20:47:55.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:55.494+0000 7fdd83020700 1 -- 172.21.15.43:0/2442388911 wait complete. 2024-04-25T20:47:56.237 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:55 smithi043 ceph-mon[29167]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:55 smithi195 ceph-mon[33250]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:55 smithi112 ceph-mon[32322]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:47:58.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.031+0000 7f746e474700 1 -- 172.21.15.43:0/3006173218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806b980 msgr2=0x7f746810f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.031+0000 7f746e474700 1 --2- 172.21.15.43:0/3006173218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806b980 0x7f746810f8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f746000b0a0 tx=0x7f746000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 -- 172.21.15.43:0/3006173218 shutdown_connections 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 --2- 172.21.15.43:0/3006173218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806b980 0x7f746810f8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 --2- 172.21.15.43:0/3006173218 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7468108a20 0x7f7468108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 --2- 172.21.15.43:0/3006173218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f746806afe0 0x7f746806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 -- 172.21.15.43:0/3006173218 >> 172.21.15.43:0/3006173218 conn(0x7f74680788b0 msgr2=0x7f7468078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 -- 172.21.15.43:0/3006173218 shutdown_connections 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 -- 172.21.15.43:0/3006173218 wait complete. 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 Processor -- start 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.032+0000 7f746e474700 1 -- start start 2024-04-25T20:47:58.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 0x7f7468199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f746806b980 0x7f74681997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7468108a20 0x7f746819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112d90 con 0x7f746806afe0 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f7467fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 0x7f7468199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f7467fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 0x7f7468199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48666/0 (socket says 172.21.15.43:48666) 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f7467fff700 1 -- 172.21.15.43:0/917701224 learned_addr learned my addr 172.21.15.43:0/917701224 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:47:58.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112c10 con 0x7f7468108a20 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112f10 con 0x7f746806b980 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.033+0000 7f746ca11700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7468108a20 0x7f746819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f74677fe700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f746806b980 0x7f74681997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 -- 172.21.15.43:0/917701224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f746806b980 msgr2=0x7f74681997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f746806b980 0x7f74681997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 -- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7468108a20 msgr2=0x7f746819db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7468108a20 0x7f746819db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746819e290 con 0x7f746806afe0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f7467fff700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 0x7f7468199280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f745800d980 tx=0x7f745800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458016070 con 0x7f746806afe0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746819e580 con 0x7f746806afe0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7458004d00 con 0x7f746806afe0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74580056d0 con 0x7f746806afe0 2024-04-25T20:47:58.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.034+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74681a5e00 con 0x7f746806afe0 2024-04-25T20:47:58.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.035+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74680630d0 con 0x7f746806afe0 2024-04-25T20:47:58.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.037+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7458004750 con 0x7f746806afe0 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.038+0000 7f74657fa700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f74500a3e70 0x7f74500a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.038+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f74580d0970 con 0x7f746806afe0 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f74677fe700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f74500a3e70 0x7f74500a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f74657fa700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] conn(0x7f74500ad9b0 0x7f74500afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7458015ec0 con 0x7f74500ad9b0 2024-04-25T20:47:58.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f74580d0d20 con 0x7f746806afe0 2024-04-25T20:47:58.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f746ca11700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] conn(0x7f74500ad9b0 0x7f74500afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:47:58.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.039+0000 7f74677fe700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f74500a3e70 0x7f74500a6330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7468078e20 tx=0x7f745c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:58.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.040+0000 7f746ca11700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] conn(0x7f74500ad9b0 0x7f74500afe50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:47:58.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.040+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== osd.1 v2:172.21.15.112:6800/3348323695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7458015ec0 con 0x7f74500ad9b0 2024-04-25T20:47:58.050 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:58.051 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:58.051 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:47:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.074+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 --> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7468063320 con 0x7f74500ad9b0 2024-04-25T20:47:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.074+0000 7f74657fa700 1 -- 172.21.15.43:0/917701224 <== osd.1 v2:172.21.15.112:6800/3348323695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7468063320 con 0x7f74500ad9b0 2024-04-25T20:47:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] conn(0x7f74500ad9b0 msgr2=0x7f74500afe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] conn(0x7f74500ad9b0 0x7f74500afe50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:47:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f74500a3e70 msgr2=0x7f74500a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f74500a3e70 0x7f74500a6330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7468078e20 tx=0x7f745c009260 comp rx=0 tx=0).stop 2024-04-25T20:47:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 msgr2=0x7f7468199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:47:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.075+0000 7f746e474700 1 --2- 172.21.15.43:0/917701224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746806afe0 0x7f7468199280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f745800d980 tx=0x7f745800dc90 comp rx=0 tx=0).stop 2024-04-25T20:47:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.076+0000 7f746ca11700 1 -- 172.21.15.43:0/917701224 reap_dead start 2024-04-25T20:47:58.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.076+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 shutdown_connections 2024-04-25T20:47:58.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.076+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 >> 172.21.15.43:0/917701224 conn(0x7f74680788b0 msgr2=0x7f74680ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:47:58.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.077+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 shutdown_connections 2024-04-25T20:47:58.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:47:58.077+0000 7f746e474700 1 -- 172.21.15.43:0/917701224 wait complete. 2024-04-25T20:47:58.767 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:47:58 smithi043 ceph-mon[29167]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:47:58.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:47:58 smithi195 ceph-mon[33250]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:47:58.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:47:58 smithi112 ceph-mon[32322]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:00.095 INFO:teuthology.orchestra.run.smithi043.stdout:223338299445 2024-04-25T20:48:00.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-25T20:48:00.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:00 smithi043 ceph-mon[29167]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:48:00.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:00 smithi195 ceph-mon[33250]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:48:00.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:00 smithi112 ceph-mon[32322]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2992251830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68102ac0 msgr2=0x7f0f68102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2992251830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68102ac0 0x7f0f68102f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009990 tx=0x7f0f5c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2992251830 shutdown_connections 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2992251830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f68108a70 0x7f0f68108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2992251830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f68103460 0x7f0f6810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2992251830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68102ac0 0x7f0f68102f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2992251830 >> 172.21.15.43:0/2992251830 conn(0x7f0f68079b10 msgr2=0x7f0f68079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2992251830 shutdown_connections 2024-04-25T20:48:01.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.124+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2992251830 wait complete. 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 Processor -- start 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 -- start start 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f68102ac0 0x7f0f6819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 0x7f0f6819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f68108a70 0x7f0f6819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112dd0 con 0x7f0f68103460 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112c50 con 0x7f0f68102ac0 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6cde4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112f50 con 0x7f0f68108a70 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 0x7f0f6819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 0x7f0f6819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48682/0 (socket says 172.21.15.43:48682) 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 -- 172.21.15.43:0/2793487872 learned_addr learned my addr 172.21.15.43:0/2793487872 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f6659c700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f68102ac0 0x7f0f6819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f66d9d700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f68108a70 0x7f0f6819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:01.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 -- 172.21.15.43:0/2793487872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f68108a70 msgr2=0x7f0f6819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f68108a70 0x7f0f6819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 -- 172.21.15.43:0/2793487872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f68102ac0 msgr2=0x7f0f6819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f68102ac0 0x7f0f6819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.125+0000 7f0f65d9b700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f681a03c0 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f65d9b700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 0x7f0f6819b8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000c00 tx=0x7f0f5c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c027070 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0f5c003fb0 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f681a0650 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c022e10 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.126+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681a7f30 con 0x7f0f68103460 2024-04-25T20:48:01.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.127+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f68101310 con 0x7f0f68103460 2024-04-25T20:48:01.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.128+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f0f5c02a070 con 0x7f0f68103460 2024-04-25T20:48:01.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f577fe700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0f500a3d50 0x7f0f500a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f0f5c0d1530 con 0x7f0f68103460 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f6659c700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0f500a3d50 0x7f0f500a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f577fe700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] conn(0x7f0f500ad890 0x7f0f500afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f5c018e50 con 0x7f0f500ad890 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c0d1980 con 0x7f0f68103460 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.129+0000 7f0f66d9d700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] conn(0x7f0f500ad890 0x7f0f500afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.130+0000 7f0f6659c700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0f500a3d50 0x7f0f500a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005950 tx=0x7f0f5800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.130+0000 7f0f66d9d700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] conn(0x7f0f500ad890 0x7f0f500afd30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.131+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== osd.3 v2:172.21.15.43:6810/3411063045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f5c018e50 con 0x7f0f500ad890 2024-04-25T20:48:01.135 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.148+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 --> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f681041b0 con 0x7f0f500ad890 2024-04-25T20:48:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.148+0000 7f0f577fe700 1 -- 172.21.15.43:0/2793487872 <== osd.3 v2:172.21.15.43:6810/3411063045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0f681041b0 con 0x7f0f500ad890 2024-04-25T20:48:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] conn(0x7f0f500ad890 msgr2=0x7f0f500afd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] conn(0x7f0f500ad890 0x7f0f500afd30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0f500a3d50 msgr2=0x7f0f500a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0f500a3d50 0x7f0f500a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f58005950 tx=0x7f0f5800b410 comp rx=0 tx=0).stop 2024-04-25T20:48:01.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 msgr2=0x7f0f6819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 --2- 172.21.15.43:0/2793487872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f68103460 0x7f0f6819b8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c000c00 tx=0x7f0f5c009f50 comp rx=0 tx=0).stop 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f66d9d700 1 -- 172.21.15.43:0/2793487872 reap_dead start 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 shutdown_connections 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 >> 172.21.15.43:0/2793487872 conn(0x7f0f68079b10 msgr2=0x7f0f68100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 shutdown_connections 2024-04-25T20:48:01.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:01.149+0000 7f0f6cde4700 1 -- 172.21.15.43:0/2793487872 wait complete. 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 -- 172.21.15.43:0/2659843328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e01079b0 msgr2=0x7f96e006b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 --2- 172.21.15.43:0/2659843328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e01079b0 0x7f96e006b190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009990 tx=0x7f96dc009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 -- 172.21.15.43:0/2659843328 shutdown_connections 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 --2- 172.21.15.43:0/2659843328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96e01054c0 0x7f96e0105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 --2- 172.21.15.43:0/2659843328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e01079b0 0x7f96e006b190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 --2- 172.21.15.43:0/2659843328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e0107e20 0x7f96e006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 -- 172.21.15.43:0/2659843328 >> 172.21.15.43:0/2659843328 conn(0x7f96e0078830 msgr2=0x7f96e0078c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 -- 172.21.15.43:0/2659843328 shutdown_connections 2024-04-25T20:48:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.542+0000 7f96e79b9700 1 -- 172.21.15.43:0/2659843328 wait complete. 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 Processor -- start 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 -- start start 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96e01054c0 0x7f96e01a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e01079b0 0x7f96e01a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 0x7f96e019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f96e01193c0 con 0x7f96e0107e20 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0119240 con 0x7f96e01054c0 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e79b9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0119540 con 0x7f96e01079b0 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e5f56700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 0x7f96e019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e5f56700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 0x7f96e019f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48700/0 (socket says 172.21.15.43:48700) 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e5f56700 1 -- 172.21.15.43:0/3741379978 learned_addr learned my addr 172.21.15.43:0/3741379978 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.543+0000 7f96e5755700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96e01054c0 0x7f96e01a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 -- 172.21.15.43:0/3741379978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e01079b0 msgr2=0x7f96e01a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e01079b0 0x7f96e01a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 -- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96e01054c0 msgr2=0x7f96e01a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96e01054c0 0x7f96e01a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e01a0020 con 0x7f96e0107e20 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e5f56700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 0x7f96e019f740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96d800b970 tx=0x7f96d800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8019070 con 0x7f96e0107e20 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96d800ce00 con 0x7f96e0107e20 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.544+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e01a0310 con 0x7f96e0107e20 2024-04-25T20:48:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.545+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01ac5a0 con 0x7f96e0107e20 2024-04-25T20:48:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.545+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007370 con 0x7f96e0107e20 2024-04-25T20:48:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.545+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96e01034a0 con 0x7f96e0107e20 2024-04-25T20:48:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.547+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f96d801c070 con 0x7f96e0107e20 2024-04-25T20:48:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96d67fc700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96cc0a3e20 0x7f96cc0a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f96d80cff00 con 0x7f96e0107e20 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96e5755700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96cc0a3e20 0x7f96cc0a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96d67fc700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] conn(0x7f96cc0ad960 0x7f96cc0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96d8015e80 con 0x7f96cc0ad960 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.549+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f96d80d0350 con 0x7f96e0107e20 2024-04-25T20:48:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.550+0000 7f96e4f54700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] conn(0x7f96cc0ad960 0x7f96cc0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.550+0000 7f96e5755700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96cc0a3e20 0x7f96cc0a62e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0098e0 tx=0x7f96dc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.551+0000 7f96e4f54700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] conn(0x7f96cc0ad960 0x7f96cc0afe00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:02.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.551+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== osd.10 v2:172.21.15.112:6824/3019340064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96d8015e80 con 0x7f96cc0ad960 2024-04-25T20:48:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.582+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 --> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96e0101fa0 con 0x7f96cc0ad960 2024-04-25T20:48:02.583 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:02 smithi043 ceph-mon[29167]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.583+0000 7f96d67fc700 1 -- 172.21.15.43:0/3741379978 <== osd.10 v2:172.21.15.112:6824/3019340064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f96e0101fa0 con 0x7f96cc0ad960 2024-04-25T20:48:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.583+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] conn(0x7f96cc0ad960 msgr2=0x7f96cc0afe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.583+0000 7f96e79b9700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] conn(0x7f96cc0ad960 0x7f96cc0afe00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.583+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96cc0a3e20 msgr2=0x7f96cc0a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.583+0000 7f96e79b9700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f96cc0a3e20 0x7f96cc0a62e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0098e0 tx=0x7f96dc00b540 comp rx=0 tx=0).stop 2024-04-25T20:48:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 msgr2=0x7f96e019f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 --2- 172.21.15.43:0/3741379978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96e0107e20 0x7f96e019f740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96d800b970 tx=0x7f96d800bc80 comp rx=0 tx=0).stop 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e5f56700 1 -- 172.21.15.43:0/3741379978 reap_dead start 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 shutdown_connections 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 >> 172.21.15.43:0/3741379978 conn(0x7f96e0078830 msgr2=0x7f96e0102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 shutdown_connections 2024-04-25T20:48:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:02.584+0000 7f96e79b9700 1 -- 172.21.15.43:0/3741379978 wait complete. 2024-04-25T20:48:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:02 smithi195 ceph-mon[33250]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:02.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:02 smithi112 ceph-mon[32322]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:03.022 INFO:teuthology.orchestra.run.smithi043.stdout:55834574934 2024-04-25T20:48:03.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T20:48:03.979 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:03.980 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:04.780 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:04 smithi043 ceph-mon[29167]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:04.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:04 smithi195 ceph-mon[33250]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:04.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:04 smithi112 ceph-mon[32322]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 -- 172.21.15.43:0/1717468084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 msgr2=0x7fe9c810e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 --2- 172.21.15.43:0/1717468084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c810e7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000b0a0 tx=0x7fe9c000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 -- 172.21.15.43:0/1717468084 shutdown_connections 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 --2- 172.21.15.43:0/1717468084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c810e7d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 --2- 172.21.15.43:0/1717468084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8106930 0x7fe9c8106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 --2- 172.21.15.43:0/1717468084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9c8101c90 0x7fe9c8102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.351+0000 7fe9ce543700 1 -- 172.21.15.43:0/1717468084 >> 172.21.15.43:0/1717468084 conn(0x7fe9c80777b0 msgr2=0x7fe9c8077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.352+0000 7fe9ce543700 1 -- 172.21.15.43:0/1717468084 shutdown_connections 2024-04-25T20:48:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.352+0000 7fe9ce543700 1 -- 172.21.15.43:0/1717468084 wait complete. 2024-04-25T20:48:05.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.352+0000 7fe9ce543700 1 Processor -- start 2024-04-25T20:48:05.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.352+0000 7fe9ce543700 1 -- start start 2024-04-25T20:48:05.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8101c90 0x7fe9c81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9c8106930 0x7fe9c819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8111d00 con 0x7fe9c8102650 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8111b80 con 0x7fe9c8101c90 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8111e80 con 0x7fe9c8106930 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48704/0 (socket says 172.21.15.43:48704) 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 -- 172.21.15.43:0/3514199281 learned_addr learned my addr 172.21.15.43:0/3514199281 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c7fff700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8101c90 0x7fe9c81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 -- 172.21.15.43:0/3514199281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9c8106930 msgr2=0x7fe9c819da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9c8106930 0x7fe9c819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 -- 172.21.15.43:0/3514199281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8101c90 msgr2=0x7fe9c81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8101c90 0x7fe9c81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 -- 172.21.15.43:0/3514199281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c819e1c0 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c77fe700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00b530 tx=0x7fe9bc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc015020 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c819e4b0 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.353+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9bc011d00 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.354+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c81a5d30 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.354+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00f2e0 con 0x7fe9c8102650 2024-04-25T20:48:05.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.354+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c81030b0 con 0x7fe9c8102650 2024-04-25T20:48:05.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.356+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe9bc018020 con 0x7fe9c8102650 2024-04-25T20:48:05.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.357+0000 7fe9c57fa700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 0x7fe9b00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:05.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.357+0000 7fe9c7fff700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 0x7fe9b00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:05.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.357+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe9bc0d02b0 con 0x7fe9c8102650 2024-04-25T20:48:05.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.357+0000 7fe9c7fff700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 0x7fe9b00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8079cd0 tx=0x7fe9b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:05.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.361+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe9bc01f020 con 0x7fe9c8102650 2024-04-25T20:48:05.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.573+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe9c802df80 con 0x7fe9c8102650 2024-04-25T20:48:05.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.573+0000 7fe9c57fa700 1 -- 172.21.15.43:0/3514199281 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe9bc09cbf0 con 0x7fe9c8102650 2024-04-25T20:48:05.574 INFO:teuthology.orchestra.run.smithi043.stdout:257698037811 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 msgr2=0x7fe9b00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 0x7fe9b00a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8079cd0 tx=0x7fe9b800b410 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 msgr2=0x7fe9c81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00b530 tx=0x7fe9bc00b840 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 shutdown_connections 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe9b00a3cd0 0x7fe9b00a6190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9c8106930 0x7fe9c819da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9c8101c90 0x7fe9c81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 --2- 172.21.15.43:0/3514199281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c8102650 0x7fe9c81996f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 >> 172.21.15.43:0/3514199281 conn(0x7fe9c80777b0 msgr2=0x7fe9c806b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 shutdown_connections 2024-04-25T20:48:05.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:05.575+0000 7fe9ce543700 1 -- 172.21.15.43:0/3514199281 wait complete. 2024-04-25T20:48:05.936 INFO:teuthology.orchestra.run.smithi043.stdout:313532612648 2024-04-25T20:48:05.936 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-25T20:48:06.500 INFO:teuthology.orchestra.run.smithi043.stdout:111669149771 2024-04-25T20:48:06.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T20:48:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:06 smithi043 ceph-mon[29167]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:48:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:06 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3514199281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T20:48:06.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:06 smithi195 ceph-mon[33250]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:48:06.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:06 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3514199281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T20:48:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:06 smithi112 ceph-mon[32322]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-25T20:48:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:06 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3514199281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T20:48:07.297 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:08.726 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:08 smithi043 ceph-mon[29167]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:08.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:08 smithi195 ceph-mon[33250]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:08.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:08 smithi112 ceph-mon[32322]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:48:09.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.180+0000 7fe6155cf700 1 -- 172.21.15.43:0/13363447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610102a90 msgr2=0x7fe610102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.180+0000 7fe6155cf700 1 --2- 172.21.15.43:0/13363447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610102a90 0x7fe610102f10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe604009990 tx=0x7fe604009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 -- 172.21.15.43:0/13363447 shutdown_connections 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 --2- 172.21.15.43:0/13363447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610108a50 0x7fe610108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 --2- 172.21.15.43:0/13363447 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 0x7fe61010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 --2- 172.21.15.43:0/13363447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610102a90 0x7fe610102f10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 -- 172.21.15.43:0/13363447 >> 172.21.15.43:0/13363447 conn(0x7fe610079ba0 msgr2=0x7fe610079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 -- 172.21.15.43:0/13363447 shutdown_connections 2024-04-25T20:48:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 -- 172.21.15.43:0/13363447 wait complete. 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.181+0000 7fe6155cf700 1 Processor -- start 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 -- start start 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 0x7fe610199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 0x7fe610199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe610112d40 con 0x7fe610108a50 2024-04-25T20:48:09.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe610112bc0 con 0x7fe610103450 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe6155cf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe610112ec0 con 0x7fe610102a90 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55202/0 (socket says 172.21.15.43:55202) 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60f7fe700 1 -- 172.21.15.43:0/605059142 learned_addr learned my addr 172.21.15.43:0/605059142 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 0x7fe610199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60e7fc700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 0x7fe610199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 -- 172.21.15.43:0/605059142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 msgr2=0x7fe610199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 0x7fe610199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 -- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 msgr2=0x7fe61019dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60effd700 1 -- 172.21.15.43:0/605059142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61019e220 con 0x7fe610102a90 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.182+0000 7fe60f7fe700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:09.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe60effd700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 0x7fe610199210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe60000d950 tx=0x7fe60000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600016070 con 0x7fe610102a90 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe60000fd60 con 0x7fe610102a90 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61019e510 con 0x7fe610102a90 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e3b0 con 0x7fe610102a90 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.183+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6101a5d90 con 0x7fe610102a90 2024-04-25T20:48:09.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.184+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe610069730 con 0x7fe610102a90 2024-04-25T20:48:09.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.185+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe600019070 con 0x7fe610102a90 2024-04-25T20:48:09.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.186+0000 7fe5f7fff700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 0x7fe5f80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.186+0000 7fe60e7fc700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 0x7fe5f80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.186+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe6000d0470 con 0x7fe610102a90 2024-04-25T20:48:09.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.186+0000 7fe60e7fc700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 0x7fe5f80a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6040098e0 tx=0x7fe604005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:09.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.190+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe60009cca0 con 0x7fe610102a90 2024-04-25T20:48:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.413+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe61002df80 con 0x7fe610102a90 2024-04-25T20:48:09.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.414+0000 7fe5f7fff700 1 -- 172.21.15.43:0/605059142 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe60009c5a0 con 0x7fe610102a90 2024-04-25T20:48:09.416 INFO:teuthology.orchestra.run.smithi043.stdout:146028888136 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 msgr2=0x7fe5f80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 0x7fe5f80a6190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6040098e0 tx=0x7fe604005960 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 msgr2=0x7fe610199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 0x7fe610199210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe60000d950 tx=0x7fe60000dc60 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 shutdown_connections 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe5f80a3cd0 0x7fe5f80a6190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe610102a90 0x7fe610199210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe610108a50 0x7fe61019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 --2- 172.21.15.43:0/605059142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe610103450 0x7fe610199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 >> 172.21.15.43:0/605059142 conn(0x7fe610079ba0 msgr2=0x7fe6101018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 shutdown_connections 2024-04-25T20:48:09.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.416+0000 7fe6155cf700 1 -- 172.21.15.43:0/605059142 wait complete. 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 -- 172.21.15.43:0/2968140852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0075590 msgr2=0x7faab010ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 --2- 172.21.15.43:0/2968140852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0075590 0x7faab010ef30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009990 tx=0x7faaa0009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 -- 172.21.15.43:0/2968140852 shutdown_connections 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 --2- 172.21.15.43:0/2968140852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab0074c70 0x7faab0075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 --2- 172.21.15.43:0/2968140852 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab010f470 0x7faab0111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 --2- 172.21.15.43:0/2968140852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0075590 0x7faab010ef30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.075+0000 7faab77af700 1 -- 172.21.15.43:0/2968140852 >> 172.21.15.43:0/2968140852 conn(0x7faab0079bf0 msgr2=0x7faab007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:09.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.076+0000 7faab77af700 1 -- 172.21.15.43:0/2968140852 shutdown_connections 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.076+0000 7faab77af700 1 -- 172.21.15.43:0/2968140852 wait complete. 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.076+0000 7faab77af700 1 Processor -- start 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.076+0000 7faab77af700 1 -- start start 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab0075590 0x7faab019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab010f470 0x7faab019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faab0114fe0 con 0x7faab0074c70 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faab0114e60 con 0x7faab0075590 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab77af700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faab0115160 con 0x7faab010f470 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55194/0 (socket says 172.21.15.43:55194) 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 -- 172.21.15.43:0/610937178 learned_addr learned my addr 172.21.15.43:0/610937178 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:09.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab4d4a700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab0075590 0x7faab019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.702 INFO:teuthology.orchestra.run.smithi043.stdout:167503724612 2024-04-25T20:48:09.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab5d4c700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab010f470 0x7faab019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 -- 172.21.15.43:0/610937178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab010f470 msgr2=0x7faab019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab010f470 0x7faab019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 -- 172.21.15.43:0/610937178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab0075590 msgr2=0x7faab019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab0075590 0x7faab019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 -- 172.21.15.43:0/610937178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab01a04d0 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faab554b700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e9c0 tx=0x7faaac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac00cbd0 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.077+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faaac00ee60 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.078+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab01a07c0 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.078+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac005670 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.078+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab01a8040 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.079+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab0069730 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.080+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7faaac004750 con 0x7faab0074c70 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.080+0000 7faaa67fc700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 0x7faa9c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.081+0000 7faab4d4a700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 0x7faa9c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:09.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.081+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7faaac0d09e0 con 0x7faab0074c70 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.081+0000 7faab4d4a700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 0x7faa9c0a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b2e0 tx=0x7faaa0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.089+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faaac053ff0 con 0x7faab0074c70 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.301+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faab002df80 con 0x7faab0074c70 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.301+0000 7faaa67fc700 1 -- 172.21.15.43:0/610937178 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faaac09d270 con 0x7faab0074c70 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 msgr2=0x7faa9c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 0x7faa9c0a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faaa000b2e0 tx=0x7faaa0005960 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 msgr2=0x7faab019b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e9c0 tx=0x7faaac00ecd0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 shutdown_connections 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7faa9c0a3cd0 0x7faa9c0a6190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faab010f470 0x7faab019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faab0074c70 0x7faab019b510 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 --2- 172.21.15.43:0/610937178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faab0075590 0x7faab019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:09.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 >> 172.21.15.43:0/610937178 conn(0x7faab0079bf0 msgr2=0x7faab00ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 shutdown_connections 2024-04-25T20:48:09.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:09.304+0000 7faab77af700 1 -- 172.21.15.43:0/610937178 wait complete. 2024-04-25T20:48:09.705 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/610937178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T20:48:09.705 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:09 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/605059142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T20:48:09.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/610937178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T20:48:09.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:09 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/605059142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T20:48:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/610937178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T20:48:09.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:09 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/605059142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T20:48:10.479 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724606 got 167503724612 for osd.5 2024-04-25T20:48:10.480 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:10.786 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:10 smithi043 ceph-mon[29167]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:10.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:10 smithi195 ceph-mon[33250]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:10.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:10 smithi112 ceph-mon[32322]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:11.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 -- 172.21.15.43:0/582255594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4102a90 msgr2=0x7f7ba4102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 --2- 172.21.15.43:0/582255594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4102a90 0x7f7ba4102f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009990 tx=0x7f7b94009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 -- 172.21.15.43:0/582255594 shutdown_connections 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 --2- 172.21.15.43:0/582255594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4108a50 0x7f7ba4108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 --2- 172.21.15.43:0/582255594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 0x7f7ba410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 --2- 172.21.15.43:0/582255594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4102a90 0x7f7ba4102f10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.216+0000 7f7babe5c700 1 -- 172.21.15.43:0/582255594 >> 172.21.15.43:0/582255594 conn(0x7f7ba4079ba0 msgr2=0x7f7ba4079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- 172.21.15.43:0/582255594 shutdown_connections 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- 172.21.15.43:0/582255594 wait complete. 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 Processor -- start 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- start start 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4102a90 0x7f7ba4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 0x7f7ba41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112da0 con 0x7f7ba4108a50 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112c20 con 0x7f7ba4103450 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.217+0000 7f7babe5c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4112f20 con 0x7f7ba4102a90 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55218/0 (socket says 172.21.15.43:55218) 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 -- 172.21.15.43:0/1940858273 learned_addr learned my addr 172.21.15.43:0/1940858273 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7ba9bf8700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4102a90 0x7f7ba4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7ba93f7700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 0x7f7ba41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 -- 172.21.15.43:0/1940858273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4102a90 msgr2=0x7f7ba4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4102a90 0x7f7ba4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 -- 172.21.15.43:0/1940858273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 msgr2=0x7f7ba41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 0x7f7ba41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 -- 172.21.15.43:0/1940858273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba419e2a0 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7baa3f9700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00ada0 tx=0x7f7b9c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c017020 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba419e590 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b9c00ce50 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c005560 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.218+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba41a5e10 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.219+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba4069730 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.220+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7b9c004ad0 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.221+0000 7f7b9affd700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 0x7f7b900a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.221+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f7b9c0d0340 con 0x7f7ba4108a50 2024-04-25T20:48:11.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.221+0000 7f7ba9bf8700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 0x7f7b900a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.222+0000 7f7ba9bf8700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 0x7f7b900a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0006fd0 tx=0x7f7ba0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:11.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.225+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7b9c021020 con 0x7f7ba4108a50 2024-04-25T20:48:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.436+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7ba402df80 con 0x7f7ba4108a50 2024-04-25T20:48:11.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.437+0000 7f7b9affd700 1 -- 172.21.15.43:0/1940858273 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b9c09cc60 con 0x7f7ba4108a50 2024-04-25T20:48:11.438 INFO:teuthology.orchestra.run.smithi043.stdout:34359738461 2024-04-25T20:48:11.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 msgr2=0x7f7b900a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 0x7f7b900a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0006fd0 tx=0x7f7ba0008040 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 msgr2=0x7f7ba419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00ada0 tx=0x7f7b9c00c330 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 shutdown_connections 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7b900a3cd0 0x7f7b900a6190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ba4102a90 0x7f7ba4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ba4108a50 0x7f7ba419db60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 --2- 172.21.15.43:0/1940858273 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7ba4103450 0x7f7ba41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 >> 172.21.15.43:0/1940858273 conn(0x7f7ba4079ba0 msgr2=0x7f7ba4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 shutdown_connections 2024-04-25T20:48:11.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.439+0000 7f7babe5c700 1 -- 172.21.15.43:0/1940858273 wait complete. 2024-04-25T20:48:11.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037807 got 257698037811 for osd.8 2024-04-25T20:48:11.681 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:11.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:11 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1940858273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T20:48:11.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:11 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1940858273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T20:48:11.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:11 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1940858273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 -- 172.21.15.43:0/505171931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90107920 msgr2=0x7fca90107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 --2- 172.21.15.43:0/505171931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90107920 0x7fca90107d00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca80009990 tx=0x7fca80009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 -- 172.21.15.43:0/505171931 shutdown_connections 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 --2- 172.21.15.43:0/505171931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 --2- 172.21.15.43:0/505171931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90107920 0x7fca90107d00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 --2- 172.21.15.43:0/505171931 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90101970 0x7fca90101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 -- 172.21.15.43:0/505171931 >> 172.21.15.43:0/505171931 conn(0x7fca900788e0 msgr2=0x7fca90078cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 -- 172.21.15.43:0/505171931 shutdown_connections 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.963+0000 7fca94dfc700 1 -- 172.21.15.43:0/505171931 wait complete. 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 Processor -- start 2024-04-25T20:48:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 -- start start 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90107920 0x7fca901a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111c80 con 0x7fca90101970 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111b00 con 0x7fca90107920 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca94dfc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111e00 con 0x7fca90102310 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca8e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca8e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55236/0 (socket says 172.21.15.43:55236) 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca8e59c700 1 -- 172.21.15.43:0/233361871 learned_addr learned my addr 172.21.15.43:0/233361871 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca8dd9b700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.964+0000 7fca8ed9d700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90107920 0x7fca901a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 -- 172.21.15.43:0/233361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 msgr2=0x7fca9019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 -- 172.21.15.43:0/233361871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90107920 msgr2=0x7fca901a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90107920 0x7fca901a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 -- 172.21.15.43:0/233361871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca901a56a0 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8dd9b700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca8e59c700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca80009590 tx=0x7fca80009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80027070 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca901a5870 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca80003fb0 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80022cd0 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.965+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca901a5d70 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.966+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca90103060 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.967+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fca8002a070 con 0x7fca90101970 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.968+0000 7fca7f7fe700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 0x7fca780a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.968+0000 7fca8dd9b700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 0x7fca780a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.968+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fca800d1b50 con 0x7fca90101970 2024-04-25T20:48:11.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.968+0000 7fca8dd9b700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 0x7fca780a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca84005950 tx=0x7fca840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:11.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:11.972+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca80031020 con 0x7fca90101970 2024-04-25T20:48:12.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.181+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fca9002df80 con 0x7fca90101970 2024-04-25T20:48:12.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.181+0000 7fca7f7fe700 1 -- 172.21.15.43:0/233361871 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fca80013070 con 0x7fca90101970 2024-04-25T20:48:12.183 INFO:teuthology.orchestra.run.smithi043.stdout:201863462974 2024-04-25T20:48:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.184+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 msgr2=0x7fca780a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.184+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 0x7fca780a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca84005950 tx=0x7fca840058e0 comp rx=0 tx=0).stop 2024-04-25T20:48:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.184+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 msgr2=0x7fca9019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:12.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.184+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca80009590 tx=0x7fca80009f50 comp rx=0 tx=0).stop 2024-04-25T20:48:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 shutdown_connections 2024-04-25T20:48:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fca780a3cd0 0x7fca780a6190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca90107920 0x7fca901a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca90101970 0x7fca9019a0e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 --2- 172.21.15.43:0/233361871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca90102310 0x7fca9019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 >> 172.21.15.43:0/233361871 conn(0x7fca900788e0 msgr2=0x7fca901007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 shutdown_connections 2024-04-25T20:48:12.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:12.185+0000 7fca94dfc700 1 -- 172.21.15.43:0/233361871 wait complete. 2024-04-25T20:48:12.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738457 got 34359738461 for osd.0 2024-04-25T20:48:12.731 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:12.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:12 smithi043 ceph-mon[29167]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:12.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:12 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/233361871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T20:48:12.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:12 smithi195 ceph-mon[33250]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:12.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:12 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/233361871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T20:48:12.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:12 smithi112 ceph-mon[32322]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:12.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:12 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/233361871' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T20:48:13.411 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462969 got 201863462974 for osd.6 2024-04-25T20:48:13.411 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:14.639 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:14.657 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:14 smithi043 ceph-mon[29167]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:14.658 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888132 got 146028888136 for osd.4 2024-04-25T20:48:14.658 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:14.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:14 smithi195 ceph-mon[33250]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:14.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:14 smithi112 ceph-mon[32322]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:15.113 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2399265651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a48108a30 msgr2=0x7f9a48108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2399265651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a48108a30 0x7f9a48108e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009990 tx=0x7f9a38009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2399265651 shutdown_connections 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2399265651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806bb30 0x7f9a4810f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2399265651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a48108a30 0x7f9a48108e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2399265651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a4806b190 0x7f9a4806b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2399265651 >> 172.21.15.43:0/2399265651 conn(0x7f9a48078910 msgr2=0x7f9a48078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:16.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2399265651 shutdown_connections 2024-04-25T20:48:16.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2399265651 wait complete. 2024-04-25T20:48:16.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 Processor -- start 2024-04-25T20:48:16.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.487+0000 7f9a4e8f8700 1 -- start start 2024-04-25T20:48:16.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806b190 0x7f9a48101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:16.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:16.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 0x7f9a481024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:16.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112d50 con 0x7f9a4806bb30 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112bd0 con 0x7f9a48108a30 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4e8f8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48112ed0 con 0x7f9a4806b190 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40858/0 (socket says 172.21.15.43:40858) 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 -- 172.21.15.43:0/2026521485 learned_addr learned my addr 172.21.15.43:0/2026521485 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a47fff700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806b190 0x7f9a48101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4ce95700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 0x7f9a481024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 -- 172.21.15.43:0/2026521485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806b190 msgr2=0x7f9a48101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806b190 0x7f9a48101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 -- 172.21.15.43:0/2026521485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 msgr2=0x7f9a481024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:16.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 0x7f9a481024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a477fe700 1 -- 172.21.15.43:0/2026521485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a481a7730 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.488+0000 7f9a4ce95700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 0x7f9a481024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a477fe700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000d950 tx=0x7f9a3000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30016070 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a481a7a20 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9a30009b40 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000f620 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.489+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481a7f60 con 0x7f9a4806bb30 2024-04-25T20:48:16.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.490+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48069730 con 0x7f9a4806bb30 2024-04-25T20:48:16.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.491+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f9a30019070 con 0x7f9a4806bb30 2024-04-25T20:48:16.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.492+0000 7f9a457fa700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 0x7f9a340a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:16.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.492+0000 7f9a47fff700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 0x7f9a340a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:16.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.492+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f9a300d0600 con 0x7f9a4806bb30 2024-04-25T20:48:16.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.492+0000 7f9a47fff700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 0x7f9a340a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a38006010 tx=0x7f9a3800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:16.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.497+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9a3009ce90 con 0x7f9a4806bb30 2024-04-25T20:48:16.712 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:16 smithi043 ceph-mon[29167]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-25T20:48:16.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.710+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9a4802e140 con 0x7f9a4806bb30 2024-04-25T20:48:16.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.711+0000 7f9a457fa700 1 -- 172.21.15.43:0/2026521485 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a3009c790 con 0x7f9a4806bb30 2024-04-25T20:48:16.713 INFO:teuthology.orchestra.run.smithi043.stdout:77309411412 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 msgr2=0x7f9a340a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 0x7f9a340a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a38006010 tx=0x7f9a3800b540 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 msgr2=0x7f9a48101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000d950 tx=0x7f9a3000dd10 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 shutdown_connections 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f9a340a3cd0 0x7f9a340a6190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a4806b190 0x7f9a48101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a48108a30 0x7f9a481024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 --2- 172.21.15.43:0/2026521485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4806bb30 0x7f9a48101f80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 >> 172.21.15.43:0/2026521485 conn(0x7f9a48078910 msgr2=0x7f9a480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 shutdown_connections 2024-04-25T20:48:16.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:16.713+0000 7f9a4e8f8700 1 -- 172.21.15.43:0/2026521485 wait complete. 2024-04-25T20:48:16.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:16 smithi195 ceph-mon[33250]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-25T20:48:16.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:16 smithi112 ceph-mon[32322]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-25T20:48:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:17.781 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:17 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2026521485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T20:48:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:17 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2026521485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T20:48:17.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:17 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2026521485' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 -- 172.21.15.43:0/3201208999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 msgr2=0x7f8c5010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 --2- 172.21.15.43:0/3201208999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c5010f930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800b0a0 tx=0x7f8c4800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 -- 172.21.15.43:0/3201208999 shutdown_connections 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 --2- 172.21.15.43:0/3201208999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 --2- 172.21.15.43:0/3201208999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c5010f930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 --2- 172.21.15.43:0/3201208999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c5006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 -- 172.21.15.43:0/3201208999 >> 172.21.15.43:0/3201208999 conn(0x7f8c500789e0 msgr2=0x7f8c50078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 -- 172.21.15.43:0/3201208999 shutdown_connections 2024-04-25T20:48:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.315+0000 7f8c55efd700 1 -- 172.21.15.43:0/3201208999 wait complete. 2024-04-25T20:48:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 Processor -- start 2024-04-25T20:48:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 -- start start 2024-04-25T20:48:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c501019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50112e10 con 0x7f8c5006bbb0 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50112c90 con 0x7f8c5006b1f0 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c55efd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50112f90 con 0x7f8c50108a60 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40874/0 (socket says 172.21.15.43:40874) 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 -- 172.21.15.43:0/1795766281 learned_addr learned my addr 172.21.15.43:0/1795766281 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4f7fe700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c501019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4ffff700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 -- 172.21.15.43:0/1795766281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 msgr2=0x7f8c50102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 -- 172.21.15.43:0/1795766281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 msgr2=0x7f8c501019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c501019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4effd700 1 -- 172.21.15.43:0/1795766281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c501a76f0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4ffff700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.316+0000 7f8c4f7fe700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c501019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c4effd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c9b0 tx=0x7f8c4400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007b00 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c501a79e0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c44007ca0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440187c0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.317+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c501a7f20 con 0x7f8c5006bbb0 2024-04-25T20:48:18.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.318+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c50069730 con 0x7f8c5006bbb0 2024-04-25T20:48:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.320+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8c4400f450 con 0x7f8c5006bbb0 2024-04-25T20:48:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.320+0000 7f8c4cff9700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 0x7f8c380a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.321+0000 7f8c4f7fe700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 0x7f8c380a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.321+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8c440d0990 con 0x7f8c5006bbb0 2024-04-25T20:48:18.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.321+0000 7f8c4f7fe700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 0x7f8c380a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c400099d0 tx=0x7f8c40008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:18.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.324+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8c44014030 con 0x7f8c5006bbb0 2024-04-25T20:48:18.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.541+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8c50102ee0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.542+0000 7f8c4cff9700 1 -- 172.21.15.43:0/1795766281 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8c50102ee0 con 0x7f8c5006bbb0 2024-04-25T20:48:18.543 INFO:teuthology.orchestra.run.smithi043.stdout:223338299449 2024-04-25T20:48:18.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 msgr2=0x7f8c380a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:18.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 0x7f8c380a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c400099d0 tx=0x7f8c40008040 comp rx=0 tx=0).stop 2024-04-25T20:48:18.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 msgr2=0x7f8c50101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c9b0 tx=0x7f8c4400cd70 comp rx=0 tx=0).stop 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 shutdown_connections 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8c380a3cd0 0x7f8c380a6190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c50108a60 0x7f8c50102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8c5006b1f0 0x7f8c501019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 --2- 172.21.15.43:0/1795766281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c5006bbb0 0x7f8c50101ef0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 >> 172.21.15.43:0/1795766281 conn(0x7f8c500789e0 msgr2=0x7f8c500ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 shutdown_connections 2024-04-25T20:48:18.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:18.544+0000 7f8c55efd700 1 -- 172.21.15.43:0/1795766281 wait complete. 2024-04-25T20:48:18.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:18 smithi043 ceph-mon[29167]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-04-25T20:48:18.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:18 smithi195 ceph-mon[33250]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-04-25T20:48:18.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:18 smithi112 ceph-mon[32322]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-04-25T20:48:19.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:19 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1795766281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T20:48:19.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:19 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1795766281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T20:48:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:19 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1795766281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T20:48:20.195 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299445 got 223338299449 for osd.7 2024-04-25T20:48:20.195 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:20.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:20 smithi043 ceph-mon[29167]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:20.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:20 smithi195 ceph-mon[33250]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:20.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:20 smithi112 ceph-mon[32322]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:21.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:21 smithi043 ceph-mon[29167]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:21.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:21 smithi195 ceph-mon[33250]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:21.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:21 smithi112 ceph-mon[32322]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 -- 172.21.15.43:0/3660044484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 msgr2=0x7f888410f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 --2- 172.21.15.43:0/3660044484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f888410f8b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f887c00b0a0 tx=0x7f887c00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 -- 172.21.15.43:0/3660044484 shutdown_connections 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 --2- 172.21.15.43:0/3660044484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f888410f8b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 --2- 172.21.15.43:0/3660044484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 0x7f8884108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 --2- 172.21.15.43:0/3660044484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 0x7f8884102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 -- 172.21.15.43:0/3660044484 >> 172.21.15.43:0/3660044484 conn(0x7f8884079ba0 msgr2=0x7f8884079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 -- 172.21.15.43:0/3660044484 shutdown_connections 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 -- 172.21.15.43:0/3660044484 wait complete. 2024-04-25T20:48:22.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.116+0000 7f888a05e700 1 Processor -- start 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 -- start start 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 0x7f88841991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 0x7f888419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8884112da0 con 0x7f8884103450 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8884112c20 con 0x7f8884108a50 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f888a05e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8884112f20 con 0x7f8884102a90 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40890/0 (socket says 172.21.15.43:40890) 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 -- 172.21.15.43:0/3901887024 learned_addr learned my addr 172.21.15.43:0/3901887024 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f88837fe700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 0x7f88841991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8883fff700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 0x7f888419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:22.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 -- 172.21.15.43:0/3901887024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 msgr2=0x7f88841991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:22.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 0x7f88841991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 -- 172.21.15.43:0/3901887024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 msgr2=0x7f888419daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:22.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 0x7f888419daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.117+0000 7f8882ffd700 1 -- 172.21.15.43:0/3901887024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888419e1e0 con 0x7f8884103450 2024-04-25T20:48:22.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f8882ffd700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f887800b530 tx=0x7f887800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:22.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878015020 con 0x7f8884103450 2024-04-25T20:48:22.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8878011d00 con 0x7f8884103450 2024-04-25T20:48:22.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888419e4d0 con 0x7f8884103450 2024-04-25T20:48:22.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878010e40 con 0x7f8884103450 2024-04-25T20:48:22.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.118+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88841a5d50 con 0x7f8884103450 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.119+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8884069730 con 0x7f8884103450 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.120+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8878018020 con 0x7f8884103450 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.121+0000 7f8880ff9700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 0x7f886c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.121+0000 7f88837fe700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 0x7f886c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.121+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f88780d0090 con 0x7f8884103450 2024-04-25T20:48:22.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.121+0000 7f88837fe700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 0x7f886c0a6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8874005950 tx=0x7f887400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:22.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.124+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f887801f020 con 0x7f8884103450 2024-04-25T20:48:22.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.335+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f888402df80 con 0x7f8884103450 2024-04-25T20:48:22.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.335+0000 7f8880ff9700 1 -- 172.21.15.43:0/3901887024 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f887809ca30 con 0x7f8884103450 2024-04-25T20:48:22.337 INFO:teuthology.orchestra.run.smithi043.stdout:292057776178 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 msgr2=0x7f886c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 0x7f886c0a6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8874005950 tx=0x7f887400b410 comp rx=0 tx=0).stop 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 msgr2=0x7f8884199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f887800b530 tx=0x7f887800b840 comp rx=0 tx=0).stop 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 shutdown_connections 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f886c0a3d50 0x7f886c0a6210 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8884102a90 0x7f88841991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8884108a50 0x7f888419daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 --2- 172.21.15.43:0/3901887024 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8884103450 0x7f8884199710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 >> 172.21.15.43:0/3901887024 conn(0x7f8884079ba0 msgr2=0x7f8884101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 shutdown_connections 2024-04-25T20:48:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:22.337+0000 7f888a05e700 1 -- 172.21.15.43:0/3901887024 wait complete. 2024-04-25T20:48:22.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:22 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3901887024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T20:48:22.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:22 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3901887024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T20:48:22.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:22 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3901887024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T20:48:23.579 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411408 got 77309411412 for osd.2 2024-04-25T20:48:23.579 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:23.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:23 smithi195 ceph-mon[33250]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:23.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:23 smithi112 ceph-mon[32322]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:23.894 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:23 smithi043 ceph-mon[29167]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:24.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 -- 172.21.15.43:0/3943126654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 msgr2=0x7fc358108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:24.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 --2- 172.21.15.43:0/3943126654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc358108e30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc354009990 tx=0x7fc354009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 -- 172.21.15.43:0/3943126654 shutdown_connections 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 --2- 172.21.15.43:0/3943126654 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc35810f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 --2- 172.21.15.43:0/3943126654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc358108e30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 --2- 172.21.15.43:0/3943126654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 -- 172.21.15.43:0/3943126654 >> 172.21.15.43:0/3943126654 conn(0x7fc358079ba0 msgr2=0x7fc358079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 -- 172.21.15.43:0/3943126654 shutdown_connections 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.782+0000 7fc360688700 1 -- 172.21.15.43:0/3943126654 wait complete. 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 Processor -- start 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 -- start start 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:24.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc358075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112da0 con 0x7fc358108a50 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112c20 con 0x7fc358103450 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc360688700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112f20 con 0x7fc358102a90 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.783+0000 7fc35ec25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40910/0 (socket says 172.21.15.43:40910) 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 -- 172.21.15.43:0/2781936396 learned_addr learned my addr 172.21.15.43:0/2781936396 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35e424700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35dc23700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc358075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 -- 172.21.15.43:0/2781936396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 msgr2=0x7fc358074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:24.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 -- 172.21.15.43:0/2781936396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 msgr2=0x7fc358075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc358075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 -- 172.21.15.43:0/2781936396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581a77c0 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35e424700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35dc23700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc358075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc35ec25700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc350007d70 tx=0x7fc35000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350016020 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3581a7ab0 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc35000ad40 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500116f0 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.784+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a7fa0 con 0x7fc358108a50 2024-04-25T20:48:24.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.785+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc358069730 con 0x7fc358108a50 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.787+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc350019020 con 0x7fc358108a50 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.788+0000 7fc34f7fe700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 0x7fc3440a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.788+0000 7fc35e424700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 0x7fc3440a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.788+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fc3500d08f0 con 0x7fc358108a50 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.788+0000 7fc35e424700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 0x7fc3440a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:24.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:23.791+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc350020020 con 0x7fc358108a50 2024-04-25T20:48:24.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.026+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc35802df80 con 0x7fc358108a50 2024-04-25T20:48:24.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.026+0000 7fc34f7fe700 1 -- 172.21.15.43:0/2781936396 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc35009d230 con 0x7fc358108a50 2024-04-25T20:48:24.028 INFO:teuthology.orchestra.run.smithi043.stdout:347892351016 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 msgr2=0x7fc3440a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 0x7fc3440a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc354000c00 tx=0x7fc354005fb0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 msgr2=0x7fc3580757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc350007d70 tx=0x7fc35000a340 comp rx=0 tx=0).stop 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 shutdown_connections 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3440a3cd0 0x7fc3440a6190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc358102a90 0x7fc358074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc358108a50 0x7fc3580757c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 --2- 172.21.15.43:0/2781936396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc358103450 0x7fc358075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 >> 172.21.15.43:0/2781936396 conn(0x7fc358079ba0 msgr2=0x7fc3581017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 shutdown_connections 2024-04-25T20:48:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.028+0000 7fc360688700 1 -- 172.21.15.43:0/2781936396 wait complete. 2024-04-25T20:48:24.664 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:24 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2781936396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T20:48:24.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:24 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2781936396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T20:48:24.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:24 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2781936396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T20:48:25.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 -- 172.21.15.43:0/2475065071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378102ac0 msgr2=0x7fc378102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:25.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/2475065071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378102ac0 0x7fc378102f40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 -- 172.21.15.43:0/2475065071 shutdown_connections 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/2475065071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378108ab0 0x7fc378108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/2475065071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378103480 0x7fc37810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/2475065071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378102ac0 0x7fc378102f40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 -- 172.21.15.43:0/2475065071 >> 172.21.15.43:0/2475065071 conn(0x7fc378079bf0 msgr2=0x7fc37807a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 -- 172.21.15.43:0/2475065071 shutdown_connections 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.994+0000 7fc37e8b5700 1 -- 172.21.15.43:0/2475065071 wait complete. 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 Processor -- start 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 -- start start 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378102ac0 0x7fc378199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378103480 0x7fc378199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:25.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc378112e10 con 0x7fc378108ab0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc378112c90 con 0x7fc378102ac0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37e8b5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc378112f90 con 0x7fc378103480 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.995+0000 7fc37ce52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40938/0 (socket says 172.21.15.43:40938) 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 -- 172.21.15.43:0/295043936 learned_addr learned my addr 172.21.15.43:0/295043936 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc377fff700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378102ac0 0x7fc378199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc3777fe700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378103480 0x7fc378199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 -- 172.21.15.43:0/295043936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378103480 msgr2=0x7fc378199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378103480 0x7fc378199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 -- 172.21.15.43:0/295043936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378102ac0 msgr2=0x7fc378199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378102ac0 0x7fc378199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 -- 172.21.15.43:0/295043936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37819e250 con 0x7fc378108ab0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37ce52700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc370007ee0 tx=0x7fc37000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:25.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370004bb0 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc370004d50 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37819e540 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700059e0 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.996+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3781a5dc0 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.997+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37810b040 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.999+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc37001a020 con 0x7fc378108ab0 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.000+0000 7fc3757fa700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 0x7fc3600a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:25.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.000+0000 7fc377fff700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 0x7fc3600a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:25.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.000+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fc3700d0320 con 0x7fc378108ab0 2024-04-25T20:48:25.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.001+0000 7fc377fff700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 0x7fc3600a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc368005950 tx=0x7fc36800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:25.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.007+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc370010070 con 0x7fc378108ab0 2024-04-25T20:48:25.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.222+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc37819a5a0 con 0x7fc378108ab0 2024-04-25T20:48:25.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.222+0000 7fc3757fa700 1 -- 172.21.15.43:0/295043936 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc37009cb50 con 0x7fc378108ab0 2024-04-25T20:48:25.224 INFO:teuthology.orchestra.run.smithi043.stdout:111669149776 2024-04-25T20:48:25.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.224+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 msgr2=0x7fc3600a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:25.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.224+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 0x7fc3600a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc368005950 tx=0x7fc36800a300 comp rx=0 tx=0).stop 2024-04-25T20:48:25.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.224+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 msgr2=0x7fc37819db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:25.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.224+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc370007ee0 tx=0x7fc37000d3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 shutdown_connections 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc3600a3cd0 0x7fc3600a6190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc378108ab0 0x7fc37819db10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc378102ac0 0x7fc378199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 --2- 172.21.15.43:0/295043936 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc378103480 0x7fc378199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 >> 172.21.15.43:0/295043936 conn(0x7fc378079bf0 msgr2=0x7fc378100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 shutdown_connections 2024-04-25T20:48:25.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.225+0000 7fc37e8b5700 1 -- 172.21.15.43:0/295043936 wait complete. 2024-04-25T20:48:25.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:25 smithi195 ceph-mon[33250]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:25.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1653041838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T20:48:25.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/295043936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T20:48:25.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:25 smithi112 ceph-mon[32322]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:25.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1653041838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T20:48:25.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/295043936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T20:48:25.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:25 smithi043 ceph-mon[29167]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:25.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1653041838' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T20:48:25.902 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/295043936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 -- 172.21.15.43:0/3590214491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 msgr2=0x7ff644102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 --2- 172.21.15.43:0/3590214491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff644102f40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff634009990 tx=0x7ff634009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 -- 172.21.15.43:0/3590214491 shutdown_connections 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 --2- 172.21.15.43:0/3590214491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 0x7ff644108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 --2- 172.21.15.43:0/3590214491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 0x7ff64410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 --2- 172.21.15.43:0/3590214491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff644102f40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.171+0000 7ff64b864700 1 -- 172.21.15.43:0/3590214491 >> 172.21.15.43:0/3590214491 conn(0x7ff644079bf0 msgr2=0x7ff64407a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.172+0000 7ff64b864700 1 -- 172.21.15.43:0/3590214491 shutdown_connections 2024-04-25T20:48:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.172+0000 7ff64b864700 1 -- 172.21.15.43:0/3590214491 wait complete. 2024-04-25T20:48:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.172+0000 7ff64b864700 1 Processor -- start 2024-04-25T20:48:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 -- start start 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 0x7ff6441997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 0x7ff64419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112e00 con 0x7ff644102ac0 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112c80 con 0x7ff644103480 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff64b864700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff644112f80 con 0x7ff644108ab0 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56564/0 (socket says 172.21.15.43:56564) 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 -- 172.21.15.43:0/2526492279 learned_addr learned my addr 172.21.15.43:0/2526492279 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649e01700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 0x7ff64419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff648dff700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 0x7ff6441997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 -- 172.21.15.43:0/2526492279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 msgr2=0x7ff64419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 0x7ff64419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 -- 172.21.15.43:0/2526492279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 msgr2=0x7ff6441997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 0x7ff6441997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.173+0000 7ff649600700 1 -- 172.21.15.43:0/2526492279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64419e2c0 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff649600700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e9a0 tx=0x7ff64000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64000ca10 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff64000cbb0 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640018680 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64419e5b0 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.174+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6441a5e30 con 0x7ff644102ac0 2024-04-25T20:48:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.175+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff644069730 con 0x7ff644102ac0 2024-04-25T20:48:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.177+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff640018820 con 0x7ff644102ac0 2024-04-25T20:48:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.178+0000 7ff63a7fc700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 0x7ff6300a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.178+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7ff6400d0820 con 0x7ff644102ac0 2024-04-25T20:48:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.178+0000 7ff648dff700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 0x7ff6300a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.179+0000 7ff648dff700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 0x7ff6300a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b790 tx=0x7ff634005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:26.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.181+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff64009d0b0 con 0x7ff644102ac0 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 -- 172.21.15.43:0/3399666812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34108a50 msgr2=0x7fab34108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 --2- 172.21.15.43:0/3399666812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34108a50 0x7fab34108e30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab24009990 tx=0x7fab24009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 -- 172.21.15.43:0/3399666812 shutdown_connections 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 --2- 172.21.15.43:0/3399666812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34103450 0x7fab3410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 --2- 172.21.15.43:0/3399666812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34108a50 0x7fab34108e30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 --2- 172.21.15.43:0/3399666812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 0x7fab34102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 -- 172.21.15.43:0/3399666812 >> 172.21.15.43:0/3399666812 conn(0x7fab34079ba0 msgr2=0x7fab34079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 -- 172.21.15.43:0/3399666812 shutdown_connections 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.867+0000 7fab397be700 1 -- 172.21.15.43:0/3399666812 wait complete. 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 Processor -- start 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 -- start start 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 0x7fab34074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34108a50 0x7fab340757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112e20 con 0x7fab34103450 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112ca0 con 0x7fab34108a50 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab397be700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112fa0 con 0x7fab34102a90 2024-04-25T20:48:26.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.868+0000 7fab327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stdout:55834574939 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40928/0 (socket says 172.21.15.43:40928) 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 -- 172.21.15.43:0/1653041838 learned_addr learned my addr 172.21.15.43:0/1653041838 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab32ffd700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 0x7fab34074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 -- 172.21.15.43:0/1653041838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 msgr2=0x7fab34074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab337fe700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34108a50 0x7fab340757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 0x7fab34074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 -- 172.21.15.43:0/1653041838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34108a50 msgr2=0x7fab340757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34108a50 0x7fab340757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 -- 172.21.15.43:0/1653041838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab341a7930 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab327fc700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab2800b530 tx=0x7fab2800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28015020 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab28011d00 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab341a7c20 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28010e60 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.869+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab341a8110 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.870+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab34069730 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.871+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fab28018020 con 0x7fab34103450 2024-04-25T20:48:26.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.872+0000 7fab1bfff700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 0x7fab1c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.872+0000 7fab32ffd700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 0x7fab1c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.872+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fab280d0280 con 0x7fab34103450 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.872+0000 7fab32ffd700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 0x7fab1c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab24005cd0 tx=0x7fab24005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:24.876+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fab2801f020 con 0x7fab34103450 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.100+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fab3402df80 con 0x7fab34103450 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.100+0000 7fab1bfff700 1 -- 172.21.15.43:0/1653041838 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab2809cbc0 con 0x7fab34103450 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 msgr2=0x7fab1c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 0x7fab1c0a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab24005cd0 tx=0x7fab24005c40 comp rx=0 tx=0).stop 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 msgr2=0x7fab34075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fab2800b530 tx=0x7fab2800b8f0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 shutdown_connections 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fab1c0a3cd0 0x7fab1c0a6190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab34102a90 0x7fab34074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab34108a50 0x7fab340757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 --2- 172.21.15.43:0/1653041838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab34103450 0x7fab34075280 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 >> 172.21.15.43:0/1653041838 conn(0x7fab34079ba0 msgr2=0x7fab34101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:26.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 shutdown_connections 2024-04-25T20:48:26.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:25.103+0000 7fab397be700 1 -- 172.21.15.43:0/1653041838 wait complete. 2024-04-25T20:48:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.395+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ff64402df80 con 0x7ff644102ac0 2024-04-25T20:48:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.396+0000 7ff63a7fc700 1 -- 172.21.15.43:0/2526492279 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff64009c9b0 con 0x7ff644102ac0 2024-04-25T20:48:26.398 INFO:teuthology.orchestra.run.smithi043.stdout:313532612652 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 msgr2=0x7ff6300a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 0x7ff6300a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b790 tx=0x7ff634005fd0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 msgr2=0x7ff6441992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e9a0 tx=0x7ff64000ecb0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 shutdown_connections 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7ff6300a3d50 0x7ff6300a6210 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff644108ab0 0x7ff64419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff644102ac0 0x7ff6441992b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 --2- 172.21.15.43:0/2526492279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff644103480 0x7ff6441997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 >> 172.21.15.43:0/2526492279 conn(0x7ff644079bf0 msgr2=0x7ff644100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 shutdown_connections 2024-04-25T20:48:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:26.398+0000 7ff64b864700 1 -- 172.21.15.43:0/2526492279 wait complete. 2024-04-25T20:48:26.667 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:26 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:48:26.667 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:26 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2526492279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T20:48:26.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:26 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:48:26.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:26 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2526492279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T20:48:26.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:26 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:48:26.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:26 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2526492279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T20:48:26.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574934 got 55834574939 for osd.1 2024-04-25T20:48:26.998 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:27.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351008 got 347892351016 for osd.11 2024-04-25T20:48:27.373 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:27.773 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:27 smithi043 ceph-mon[29167]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:27.809 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776172 got 292057776178 for osd.9 2024-04-25T20:48:27.809 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:27.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:27 smithi195 ceph-mon[33250]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:27.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:27 smithi112 ceph-mon[32322]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:28.283 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149771 got 111669149776 for osd.3 2024-04-25T20:48:28.283 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:28.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:28.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:28.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:28.941 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:28 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:28.972 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612648 got 313532612652 for osd.10 2024-04-25T20:48:28.972 DEBUG:teuthology.parallel:result is None 2024-04-25T20:48:28.972 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T20:48:28.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:48:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:28 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:28 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:29.893 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:29 smithi195 ceph-mon[33250]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:29 smithi112 ceph-mon[32322]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:30.168 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:29 smithi043 ceph-mon[29167]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 -- 172.21.15.43:0/138543700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 msgr2=0x7f8fc410f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 --2- 172.21.15.43:0/138543700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc410f830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00b0a0 tx=0x7f8fbc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 -- 172.21.15.43:0/138543700 shutdown_connections 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 --2- 172.21.15.43:0/138543700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 0x7f8fc4107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 --2- 172.21.15.43:0/138543700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc410f830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 --2- 172.21.15.43:0/138543700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 -- 172.21.15.43:0/138543700 >> 172.21.15.43:0/138543700 conn(0x7f8fc4076c60 msgr2=0x7f8fc4077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 -- 172.21.15.43:0/138543700 shutdown_connections 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.618+0000 7f8fca347700 1 -- 172.21.15.43:0/138543700 wait complete. 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 Processor -- start 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 -- start start 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc41991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 0x7f8fc419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4112dd0 con 0x7f8fc4101dc0 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4112c50 con 0x7f8fc4101400 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fca347700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4112f50 con 0x7f8fc4107b20 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fc37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fc37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56578/0 (socket says 172.21.15.43:56578) 2024-04-25T20:48:31.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.619+0000 7f8fc37fe700 1 -- 172.21.15.43:0/1214147282 learned_addr learned my addr 172.21.15.43:0/1214147282 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc3fff700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc41991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc88e4700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 0x7f8fc419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 -- 172.21.15.43:0/1214147282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 msgr2=0x7f8fc419da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 0x7f8fc419da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 -- 172.21.15.43:0/1214147282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 msgr2=0x7f8fc41991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc41991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 -- 172.21.15.43:0/1214147282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc419e1b0 con 0x7f8fc4101dc0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc3fff700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc41991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc37fe700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00b530 tx=0x7f8fac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac015020 con 0x7f8fc4101dc0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8fac011d00 con 0x7f8fc4101dc0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc419e4a0 con 0x7f8fc4101dc0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00f2e0 con 0x7f8fc4101dc0 2024-04-25T20:48:31.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.620+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc41a5da0 con 0x7f8fc4101dc0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.621+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc4069730 con 0x7f8fc4101dc0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.622+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f8fac018020 con 0x7f8fc4101dc0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.623+0000 7f8fc17fa700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 0x7f8fb00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.623+0000 7f8fc3fff700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 0x7f8fb00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.623+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8fac0d0170 con 0x7f8fc4101dc0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.623+0000 7f8fc3fff700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 0x7f8fb00a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005950 tx=0x7f8fb40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:31.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.627+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8fac01f020 con 0x7f8fc4101dc0 2024-04-25T20:48:31.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.836+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fc4062e80 con 0x7f8fb00a3d50 2024-04-25T20:48:31.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.846+0000 7f8fc17fa700 1 -- 172.21.15.43:0/1214147282 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7f8fc4062e80 con 0x7f8fb00a3d50 2024-04-25T20:48:31.852 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.849+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 msgr2=0x7f8fb00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.849+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 0x7f8fb00a6210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005950 tx=0x7f8fb40058e0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 msgr2=0x7f8fc41996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00b530 tx=0x7f8fac00b840 comp rx=0 tx=0).stop 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 shutdown_connections 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8fb00a3d50 0x7f8fb00a6210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fc4107b20 0x7f8fc419da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8fc4101400 0x7f8fc41991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 --2- 172.21.15.43:0/1214147282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fc4101dc0 0x7f8fc41996e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:31.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 >> 172.21.15.43:0/1214147282 conn(0x7f8fc4076c60 msgr2=0x7f8fc40ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:31.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 shutdown_connections 2024-04-25T20:48:31.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:31.850+0000 7f8fca347700 1 -- 172.21.15.43:0/1214147282 wait complete. 2024-04-25T20:48:31.855 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:48:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:31 smithi043 ceph-mon[29167]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:31 smithi195 ceph-mon[33250]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:31 smithi112 ceph-mon[32322]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:48:32.591 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-04-25T20:48:30.695387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663312,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1192,"num_read_kb":724,"num_write":430,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390548,"kb_used_data":12240,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551276,"statfs":{"total":1151940427776,"available":1151540506624,"internally_reserved":0,"allocated":12533760,"data_stored":7778232,"data_compressed":113820,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002884"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753171+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:47:05.753171+0000","last_peered":"2024-04-25T20:47:05.753171+0000","last_clean":"2024-04-25T20:47:05.753171+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:47:05.753171+0000","last_undegraded":"2024-04-25T20:47:05.753171+0000","last_fullsized":"2024-04-25T20:47:05.753171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753969+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:47:05.753969+0000","last_peered":"2024-04-25T20:47:05.753969+0000","last_clean":"2024-04-25T20:47:05.753969+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:47:05.753969+0000","last_undegraded":"2024-04-25T20:47:05.753969+0000","last_fullsized":"2024-04-25T20:47:05.753969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754116+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:47:05.754116+0000","last_peered":"2024-04-25T20:47:05.754116+0000","last_clean":"2024-04-25T20:47:05.754116+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:47:05.754116+0000","last_undegraded":"2024-04-25T20:47:05.754116+0000","last_fullsized":"2024-04-25T20:47:05.754116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.919088+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:47:05.919088+0000","last_peered":"2024-04-25T20:47:05.919088+0000","last_clean":"2024-04-25T20:47:05.919088+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:47:05.919088+0000","last_undegraded":"2024-04-25T20:47:05.919088+0000","last_fullsized":"2024-04-25T20:47:05.919088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756158+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:47:05.756158+0000","last_peered":"2024-04-25T20:47:05.756158+0000","last_clean":"2024-04-25T20:47:05.756158+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:47:05.756158+0000","last_undegraded":"2024-04-25T20:47:05.756158+0000","last_fullsized":"2024-04-25T20:47:05.756158+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.757617+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:47:05.757617+0000","last_peered":"2024-04-25T20:47:05.757617+0000","last_clean":"2024-04-25T20:47:05.757617+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:47:05.757617+0000","last_undegraded":"2024-04-25T20:47:05.757617+0000","last_fullsized":"2024-04-25T20:47:05.757617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754188+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:47:05.754188+0000","last_peered":"2024-04-25T20:47:05.754188+0000","last_clean":"2024-04-25T20:47:05.754188+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:47:05.754188+0000","last_undegraded":"2024-04-25T20:47:05.754188+0000","last_fullsized":"2024-04-25T20:47:05.754188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137789+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:47:06.137789+0000","last_peered":"2024-04-25T20:47:06.137789+0000","last_clean":"2024-04-25T20:47:06.137789+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:47:06.137789+0000","last_undegraded":"2024-04-25T20:47:06.137789+0000","last_fullsized":"2024-04-25T20:47:06.137789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750560+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:47:05.750560+0000","last_peered":"2024-04-25T20:47:05.750560+0000","last_clean":"2024-04-25T20:47:05.750560+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:47:05.750560+0000","last_undegraded":"2024-04-25T20:47:05.750560+0000","last_fullsized":"2024-04-25T20:47:05.750560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752879+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:47:05.752879+0000","last_peered":"2024-04-25T20:47:05.752879+0000","last_clean":"2024-04-25T20:47:05.752879+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:47:05.752879+0000","last_undegraded":"2024-04-25T20:47:05.752879+0000","last_fullsized":"2024-04-25T20:47:05.752879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754735+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:47:05.754735+0000","last_peered":"2024-04-25T20:47:05.754735+0000","last_clean":"2024-04-25T20:47:05.754735+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:47:05.754735+0000","last_undegraded":"2024-04-25T20:47:05.754735+0000","last_fullsized":"2024-04-25T20:47:05.754735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918857+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:47:05.918857+0000","last_peered":"2024-04-25T20:47:05.918857+0000","last_clean":"2024-04-25T20:47:05.918857+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:47:05.918857+0000","last_undegraded":"2024-04-25T20:47:05.918857+0000","last_fullsized":"2024-04-25T20:47:05.918857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751424+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:47:05.751424+0000","last_peered":"2024-04-25T20:47:05.751424+0000","last_clean":"2024-04-25T20:47:05.751424+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:47:05.751424+0000","last_undegraded":"2024-04-25T20:47:05.751424+0000","last_fullsized":"2024-04-25T20:47:05.751424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753402+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:47:05.753402+0000","last_peered":"2024-04-25T20:47:05.753402+0000","last_clean":"2024-04-25T20:47:05.753402+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:47:05.753402+0000","last_undegraded":"2024-04-25T20:47:05.753402+0000","last_fullsized":"2024-04-25T20:47:05.753402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753232+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:47:05.753232+0000","last_peered":"2024-04-25T20:47:05.753232+0000","last_clean":"2024-04-25T20:47:05.753232+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:47:05.753232+0000","last_undegraded":"2024-04-25T20:47:05.753232+0000","last_fullsized":"2024-04-25T20:47:05.753232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749984+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:47:05.749984+0000","last_peered":"2024-04-25T20:47:05.749984+0000","last_clean":"2024-04-25T20:47:05.749984+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:47:05.749984+0000","last_undegraded":"2024-04-25T20:47:05.749984+0000","last_fullsized":"2024-04-25T20:47:05.749984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753319+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:47:05.753319+0000","last_peered":"2024-04-25T20:47:05.753319+0000","last_clean":"2024-04-25T20:47:05.753319+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:47:05.753319+0000","last_undegraded":"2024-04-25T20:47:05.753319+0000","last_fullsized":"2024-04-25T20:47:05.753319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750440+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:47:05.750440+0000","last_peered":"2024-04-25T20:47:05.750440+0000","last_clean":"2024-04-25T20:47:05.750440+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:47:05.750440+0000","last_undegraded":"2024-04-25T20:47:05.750440+0000","last_fullsized":"2024-04-25T20:47:05.750440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:29.646594+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:48:29.646594+0000","last_peered":"2024-04-25T20:48:29.646594+0000","last_clean":"2024-04-25T20:48:29.646594+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:48:29.646594+0000","last_undegraded":"2024-04-25T20:48:29.646594+0000","last_fullsized":"2024-04-25T20:48:29.646594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138029+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:47:06.138029+0000","last_peered":"2024-04-25T20:47:06.138029+0000","last_clean":"2024-04-25T20:47:06.138029+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:47:06.138029+0000","last_undegraded":"2024-04-25T20:47:06.138029+0000","last_fullsized":"2024-04-25T20:47:06.138029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138221+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:47:06.138221+0000","last_peered":"2024-04-25T20:47:06.138221+0000","last_clean":"2024-04-25T20:47:06.138221+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:47:06.138221+0000","last_undegraded":"2024-04-25T20:47:06.138221+0000","last_fullsized":"2024-04-25T20:47:06.138221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754469+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:47:05.754469+0000","last_peered":"2024-04-25T20:47:05.754469+0000","last_clean":"2024-04-25T20:47:05.754469+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:47:05.754469+0000","last_undegraded":"2024-04-25T20:47:05.754469+0000","last_fullsized":"2024-04-25T20:47:05.754469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756813+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:47:05.756813+0000","last_peered":"2024-04-25T20:47:05.756813+0000","last_clean":"2024-04-25T20:47:05.756813+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:47:05.756813+0000","last_undegraded":"2024-04-25T20:47:05.756813+0000","last_fullsized":"2024-04-25T20:47:05.756813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750745+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:47:05.750745+0000","last_peered":"2024-04-25T20:47:05.750745+0000","last_clean":"2024-04-25T20:47:05.750745+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:47:05.750745+0000","last_undegraded":"2024-04-25T20:47:05.750745+0000","last_fullsized":"2024-04-25T20:47:05.750745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756533+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:47:05.756533+0000","last_peered":"2024-04-25T20:47:05.756533+0000","last_clean":"2024-04-25T20:47:05.756533+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:47:05.756533+0000","last_undegraded":"2024-04-25T20:47:05.756533+0000","last_fullsized":"2024-04-25T20:47:05.756533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754423+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:47:05.754423+0000","last_peered":"2024-04-25T20:47:05.754423+0000","last_clean":"2024-04-25T20:47:05.754423+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:47:05.754423+0000","last_undegraded":"2024-04-25T20:47:05.754423+0000","last_fullsized":"2024-04-25T20:47:05.754423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:24.641780+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:48:24.641780+0000","last_peered":"2024-04-25T20:48:24.641780+0000","last_clean":"2024-04-25T20:48:24.641780+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:48:24.641780+0000","last_undegraded":"2024-04-25T20:48:24.641780+0000","last_fullsized":"2024-04-25T20:48:24.641780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755999+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:47:05.755999+0000","last_peered":"2024-04-25T20:47:05.755999+0000","last_clean":"2024-04-25T20:47:05.755999+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:47:05.755999+0000","last_undegraded":"2024-04-25T20:47:05.755999+0000","last_fullsized":"2024-04-25T20:47:05.755999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752327+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:47:05.752327+0000","last_peered":"2024-04-25T20:47:05.752327+0000","last_clean":"2024-04-25T20:47:05.752327+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:47:05.752327+0000","last_undegraded":"2024-04-25T20:47:05.752327+0000","last_fullsized":"2024-04-25T20:47:05.752327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920027+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:47:05.920027+0000","last_peered":"2024-04-25T20:47:05.920027+0000","last_clean":"2024-04-25T20:47:05.920027+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:47:05.920027+0000","last_undegraded":"2024-04-25T20:47:05.920027+0000","last_fullsized":"2024-04-25T20:47:05.920027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751613+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:47:05.751613+0000","last_peered":"2024-04-25T20:47:05.751613+0000","last_clean":"2024-04-25T20:47:05.751613+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:47:05.751613+0000","last_undegraded":"2024-04-25T20:47:05.751613+0000","last_fullsized":"2024-04-25T20:47:05.751613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137900+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:47:06.137900+0000","last_peered":"2024-04-25T20:47:06.137900+0000","last_clean":"2024-04-25T20:47:06.137900+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:47:06.137900+0000","last_undegraded":"2024-04-25T20:47:06.137900+0000","last_fullsized":"2024-04-25T20:47:06.137900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754009+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:47:05.754009+0000","last_peered":"2024-04-25T20:47:05.754009+0000","last_clean":"2024-04-25T20:47:05.754009+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:47:05.754009+0000","last_undegraded":"2024-04-25T20:47:05.754009+0000","last_fullsized":"2024-04-25T20:47:05.754009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749633+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:47:05.749633+0000","last_peered":"2024-04-25T20:47:05.749633+0000","last_clean":"2024-04-25T20:47:05.749633+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:47:05.749633+0000","last_undegraded":"2024-04-25T20:47:05.749633+0000","last_fullsized":"2024-04-25T20:47:05.749633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":230,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:25.642361+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:48:25.642361+0000","last_peered":"2024-04-25T20:48:25.642361+0000","last_clean":"2024-04-25T20:48:25.642361+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:48:25.642361+0000","last_undegraded":"2024-04-25T20:48:25.642361+0000","last_fullsized":"2024-04-25T20:48:25.642361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750667+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:47:05.750667+0000","last_peered":"2024-04-25T20:47:05.750667+0000","last_clean":"2024-04-25T20:47:05.750667+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:47:05.750667+0000","last_undegraded":"2024-04-25T20:47:05.750667+0000","last_fullsized":"2024-04-25T20:47:05.750667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754768+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:47:05.754768+0000","last_peered":"2024-04-25T20:47:05.754768+0000","last_clean":"2024-04-25T20:47:05.754768+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:47:05.754768+0000","last_undegraded":"2024-04-25T20:47:05.754768+0000","last_fullsized":"2024-04-25T20:47:05.754768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754394+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:47:05.754394+0000","last_peered":"2024-04-25T20:47:05.754394+0000","last_clean":"2024-04-25T20:47:05.754394+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:47:05.754394+0000","last_undegraded":"2024-04-25T20:47:05.754394+0000","last_fullsized":"2024-04-25T20:47:05.754394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754546+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:47:05.754546+0000","last_peered":"2024-04-25T20:47:05.754546+0000","last_clean":"2024-04-25T20:47:05.754546+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:47:05.754546+0000","last_undegraded":"2024-04-25T20:47:05.754546+0000","last_fullsized":"2024-04-25T20:47:05.754546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750258+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:47:05.750258+0000","last_peered":"2024-04-25T20:47:05.750258+0000","last_clean":"2024-04-25T20:47:05.750258+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:47:05.750258+0000","last_undegraded":"2024-04-25T20:47:05.750258+0000","last_fullsized":"2024-04-25T20:47:05.750258+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":268,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:25.642367+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:48:25.642367+0000","last_peered":"2024-04-25T20:48:25.642367+0000","last_clean":"2024-04-25T20:48:25.642367+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:48:25.642367+0000","last_undegraded":"2024-04-25T20:48:25.642367+0000","last_fullsized":"2024-04-25T20:48:25.642367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64724,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":167,"num_write":35,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756435+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:47:05.756435+0000","last_peered":"2024-04-25T20:47:05.756435+0000","last_clean":"2024-04-25T20:47:05.756435+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:47:05.756435+0000","last_undegraded":"2024-04-25T20:47:05.756435+0000","last_fullsized":"2024-04-25T20:47:05.756435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750404+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:47:05.750404+0000","last_peered":"2024-04-25T20:47:05.750404+0000","last_clean":"2024-04-25T20:47:05.750404+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:47:05.750404+0000","last_undegraded":"2024-04-25T20:47:05.750404+0000","last_fullsized":"2024-04-25T20:47:05.750404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751149+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:47:05.751149+0000","last_peered":"2024-04-25T20:47:05.751149+0000","last_clean":"2024-04-25T20:47:05.751149+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:47:05.751149+0000","last_undegraded":"2024-04-25T20:47:05.751149+0000","last_fullsized":"2024-04-25T20:47:05.751149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753879+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:47:05.753879+0000","last_peered":"2024-04-25T20:47:05.753879+0000","last_clean":"2024-04-25T20:47:05.753879+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:47:05.753879+0000","last_undegraded":"2024-04-25T20:47:05.753879+0000","last_fullsized":"2024-04-25T20:47:05.753879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754629+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:47:05.754629+0000","last_peered":"2024-04-25T20:47:05.754629+0000","last_clean":"2024-04-25T20:47:05.754629+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:47:05.754629+0000","last_undegraded":"2024-04-25T20:47:05.754629+0000","last_fullsized":"2024-04-25T20:47:05.754629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:28.712692+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:48:28.712692+0000","last_peered":"2024-04-25T20:48:28.712692+0000","last_clean":"2024-04-25T20:48:28.712692+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:48:28.712692+0000","last_undegraded":"2024-04-25T20:48:28.712692+0000","last_fullsized":"2024-04-25T20:48:28.712692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754123+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:47:05.754123+0000","last_peered":"2024-04-25T20:47:05.754123+0000","last_clean":"2024-04-25T20:47:05.754123+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:47:05.754123+0000","last_undegraded":"2024-04-25T20:47:05.754123+0000","last_fullsized":"2024-04-25T20:47:05.754123+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755855+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:47:05.755855+0000","last_peered":"2024-04-25T20:47:05.755855+0000","last_clean":"2024-04-25T20:47:05.755855+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:47:05.755855+0000","last_undegraded":"2024-04-25T20:47:05.755855+0000","last_fullsized":"2024-04-25T20:47:05.755855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753858+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:47:05.753858+0000","last_peered":"2024-04-25T20:47:05.753858+0000","last_clean":"2024-04-25T20:47:05.753858+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:47:05.753858+0000","last_undegraded":"2024-04-25T20:47:05.753858+0000","last_fullsized":"2024-04-25T20:47:05.753858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756828+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:47:05.756828+0000","last_peered":"2024-04-25T20:47:05.756828+0000","last_clean":"2024-04-25T20:47:05.756828+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:47:05.756828+0000","last_undegraded":"2024-04-25T20:47:05.756828+0000","last_fullsized":"2024-04-25T20:47:05.756828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753110+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:47:05.753110+0000","last_peered":"2024-04-25T20:47:05.753110+0000","last_clean":"2024-04-25T20:47:05.753110+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:47:05.753110+0000","last_undegraded":"2024-04-25T20:47:05.753110+0000","last_fullsized":"2024-04-25T20:47:05.753110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752528+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:47:05.752528+0000","last_peered":"2024-04-25T20:47:05.752528+0000","last_clean":"2024-04-25T20:47:05.752528+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:47:05.752528+0000","last_undegraded":"2024-04-25T20:47:05.752528+0000","last_fullsized":"2024-04-25T20:47:05.752528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'6","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:26.643464+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:48:26.643464+0000","last_peered":"2024-04-25T20:48:26.643464+0000","last_clean":"2024-04-25T20:48:26.643464+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:48:26.643464+0000","last_undegraded":"2024-04-25T20:48:26.643464+0000","last_fullsized":"2024-04-25T20:48:26.643464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755662+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:47:05.755662+0000","last_peered":"2024-04-25T20:47:05.755662+0000","last_clean":"2024-04-25T20:47:05.755662+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:47:05.755662+0000","last_undegraded":"2024-04-25T20:47:05.755662+0000","last_fullsized":"2024-04-25T20:47:05.755662+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920287+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:47:05.920287+0000","last_peered":"2024-04-25T20:47:05.920287+0000","last_clean":"2024-04-25T20:47:05.920287+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:47:05.920287+0000","last_undegraded":"2024-04-25T20:47:05.920287+0000","last_fullsized":"2024-04-25T20:47:05.920287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:27.710584+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:48:27.710584+0000","last_peered":"2024-04-25T20:48:27.710584+0000","last_clean":"2024-04-25T20:48:27.710584+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:48:27.710584+0000","last_undegraded":"2024-04-25T20:48:27.710584+0000","last_fullsized":"2024-04-25T20:48:27.710584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137869+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:47:06.137869+0000","last_peered":"2024-04-25T20:47:06.137869+0000","last_clean":"2024-04-25T20:47:06.137869+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:47:06.137869+0000","last_undegraded":"2024-04-25T20:47:06.137869+0000","last_fullsized":"2024-04-25T20:47:06.137869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918914+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:47:05.918914+0000","last_peered":"2024-04-25T20:47:05.918914+0000","last_clean":"2024-04-25T20:47:05.918914+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:47:05.918914+0000","last_undegraded":"2024-04-25T20:47:05.918914+0000","last_fullsized":"2024-04-25T20:47:05.918914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":358,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754315+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:47:05.754315+0000","last_peered":"2024-04-25T20:47:05.754315+0000","last_clean":"2024-04-25T20:47:05.754315+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:47:05.754315+0000","last_undegraded":"2024-04-25T20:47:05.754315+0000","last_fullsized":"2024-04-25T20:47:05.754315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754986+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:47:05.754986+0000","last_peered":"2024-04-25T20:47:05.754986+0000","last_clean":"2024-04-25T20:47:05.754986+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:47:05.754986+0000","last_undegraded":"2024-04-25T20:47:05.754986+0000","last_fullsized":"2024-04-25T20:47:05.754986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754439+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:47:05.754439+0000","last_peered":"2024-04-25T20:47:05.754439+0000","last_clean":"2024-04-25T20:47:05.754439+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:47:05.754439+0000","last_undegraded":"2024-04-25T20:47:05.754439+0000","last_fullsized":"2024-04-25T20:47:05.754439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756678+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:47:05.756678+0000","last_peered":"2024-04-25T20:47:05.756678+0000","last_clean":"2024-04-25T20:47:05.756678+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:47:05.756678+0000","last_undegraded":"2024-04-25T20:47:05.756678+0000","last_fullsized":"2024-04-25T20:47:05.756678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751445+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:47:05.751445+0000","last_peered":"2024-04-25T20:47:05.751445+0000","last_clean":"2024-04-25T20:47:05.751445+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:47:05.751445+0000","last_undegraded":"2024-04-25T20:47:05.751445+0000","last_fullsized":"2024-04-25T20:47:05.751445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:09.498024+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:47:09.498024+0000","last_peered":"2024-04-25T20:47:09.498024+0000","last_clean":"2024-04-25T20:47:09.498024+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:47:09.498024+0000","last_undegraded":"2024-04-25T20:47:09.498024+0000","last_fullsized":"2024-04-25T20:47:09.498024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138035+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:47:06.138035+0000","last_peered":"2024-04-25T20:47:06.138035+0000","last_clean":"2024-04-25T20:47:06.138035+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:47:06.138035+0000","last_undegraded":"2024-04-25T20:47:06.138035+0000","last_fullsized":"2024-04-25T20:47:06.138035+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918866+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:47:05.918866+0000","last_peered":"2024-04-25T20:47:05.918866+0000","last_clean":"2024-04-25T20:47:05.918866+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:47:05.918866+0000","last_undegraded":"2024-04-25T20:47:05.918866+0000","last_fullsized":"2024-04-25T20:47:05.918866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754209+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:47:05.754209+0000","last_peered":"2024-04-25T20:47:05.754209+0000","last_clean":"2024-04-25T20:47:05.754209+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:47:05.754209+0000","last_undegraded":"2024-04-25T20:47:05.754209+0000","last_fullsized":"2024-04-25T20:47:05.754209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.758571+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:47:05.758571+0000","last_peered":"2024-04-25T20:47:05.758571+0000","last_clean":"2024-04-25T20:47:05.758571+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:47:05.758571+0000","last_undegraded":"2024-04-25T20:47:05.758571+0000","last_fullsized":"2024-04-25T20:47:05.758571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755850+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:47:05.755850+0000","last_peered":"2024-04-25T20:47:05.755850+0000","last_clean":"2024-04-25T20:47:05.755850+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:47:05.755850+0000","last_undegraded":"2024-04-25T20:47:05.755850+0000","last_fullsized":"2024-04-25T20:47:05.755850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137669+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:47:06.137669+0000","last_peered":"2024-04-25T20:47:06.137669+0000","last_clean":"2024-04-25T20:47:06.137669+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:47:06.137669+0000","last_undegraded":"2024-04-25T20:47:06.137669+0000","last_fullsized":"2024-04-25T20:47:06.137669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752868+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:47:05.752868+0000","last_peered":"2024-04-25T20:47:05.752868+0000","last_clean":"2024-04-25T20:47:05.752868+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:47:05.752868+0000","last_undegraded":"2024-04-25T20:47:05.752868+0000","last_fullsized":"2024-04-25T20:47:05.752868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750196+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:47:05.750196+0000","last_peered":"2024-04-25T20:47:05.750196+0000","last_clean":"2024-04-25T20:47:05.750196+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:47:05.750196+0000","last_undegraded":"2024-04-25T20:47:05.750196+0000","last_fullsized":"2024-04-25T20:47:05.750196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137753+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:47:06.137753+0000","last_peered":"2024-04-25T20:47:06.137753+0000","last_clean":"2024-04-25T20:47:06.137753+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:47:06.137753+0000","last_undegraded":"2024-04-25T20:47:06.137753+0000","last_fullsized":"2024-04-25T20:47:06.137753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.761066+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:47:05.761066+0000","last_peered":"2024-04-25T20:47:05.761066+0000","last_clean":"2024-04-25T20:47:05.761066+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:47:05.761066+0000","last_undegraded":"2024-04-25T20:47:05.761066+0000","last_fullsized":"2024-04-25T20:47:05.761066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754473+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:47:05.754473+0000","last_peered":"2024-04-25T20:47:05.754473+0000","last_clean":"2024-04-25T20:47:05.754473+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:47:05.754473+0000","last_undegraded":"2024-04-25T20:47:05.754473+0000","last_fullsized":"2024-04-25T20:47:05.754473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:28.646583+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:48:28.646583+0000","last_peered":"2024-04-25T20:48:28.646583+0000","last_clean":"2024-04-25T20:48:28.646583+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:48:28.646583+0000","last_undegraded":"2024-04-25T20:48:28.646583+0000","last_fullsized":"2024-04-25T20:48:28.646583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754966+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:47:05.754966+0000","last_peered":"2024-04-25T20:47:05.754966+0000","last_clean":"2024-04-25T20:47:05.754966+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:47:05.754966+0000","last_undegraded":"2024-04-25T20:47:05.754966+0000","last_fullsized":"2024-04-25T20:47:05.754966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754281+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:47:05.754281+0000","last_peered":"2024-04-25T20:47:05.754281+0000","last_clean":"2024-04-25T20:47:05.754281+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:47:05.754281+0000","last_undegraded":"2024-04-25T20:47:05.754281+0000","last_fullsized":"2024-04-25T20:47:05.754281+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754715+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:47:05.754715+0000","last_peered":"2024-04-25T20:47:05.754715+0000","last_clean":"2024-04-25T20:47:05.754715+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:47:05.754715+0000","last_undegraded":"2024-04-25T20:47:05.754715+0000","last_fullsized":"2024-04-25T20:47:05.754715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751385+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:47:05.751385+0000","last_peered":"2024-04-25T20:47:05.751385+0000","last_clean":"2024-04-25T20:47:05.751385+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:47:05.751385+0000","last_undegraded":"2024-04-25T20:47:05.751385+0000","last_fullsized":"2024-04-25T20:47:05.751385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754916+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:47:05.754916+0000","last_peered":"2024-04-25T20:47:05.754916+0000","last_clean":"2024-04-25T20:47:05.754916+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:47:05.754916+0000","last_undegraded":"2024-04-25T20:47:05.754916+0000","last_fullsized":"2024-04-25T20:47:05.754916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752915+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:47:05.752915+0000","last_peered":"2024-04-25T20:47:05.752915+0000","last_clean":"2024-04-25T20:47:05.752915+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:47:05.752915+0000","last_undegraded":"2024-04-25T20:47:05.752915+0000","last_fullsized":"2024-04-25T20:47:05.752915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750673+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:47:05.750673+0000","last_peered":"2024-04-25T20:47:05.750673+0000","last_clean":"2024-04-25T20:47:05.750673+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:47:05.750673+0000","last_undegraded":"2024-04-25T20:47:05.750673+0000","last_fullsized":"2024-04-25T20:47:05.750673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750126+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:47:05.750126+0000","last_peered":"2024-04-25T20:47:05.750126+0000","last_clean":"2024-04-25T20:47:05.750126+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:47:05.750126+0000","last_undegraded":"2024-04-25T20:47:05.750126+0000","last_fullsized":"2024-04-25T20:47:05.750126+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754034+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:47:05.754034+0000","last_peered":"2024-04-25T20:47:05.754034+0000","last_clean":"2024-04-25T20:47:05.754034+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:47:05.754034+0000","last_undegraded":"2024-04-25T20:47:05.754034+0000","last_fullsized":"2024-04-25T20:47:05.754034+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751248+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:47:05.751248+0000","last_peered":"2024-04-25T20:47:05.751248+0000","last_clean":"2024-04-25T20:47:05.751248+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:47:05.751248+0000","last_undegraded":"2024-04-25T20:47:05.751248+0000","last_fullsized":"2024-04-25T20:47:05.751248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752899+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:47:05.752899+0000","last_peered":"2024-04-25T20:47:05.752899+0000","last_clean":"2024-04-25T20:47:05.752899+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:47:05.752899+0000","last_undegraded":"2024-04-25T20:47:05.752899+0000","last_fullsized":"2024-04-25T20:47:05.752899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750546+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:47:05.750546+0000","last_peered":"2024-04-25T20:47:05.750546+0000","last_clean":"2024-04-25T20:47:05.750546+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:47:05.750546+0000","last_undegraded":"2024-04-25T20:47:05.750546+0000","last_fullsized":"2024-04-25T20:47:05.750546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137933+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:47:06.137933+0000","last_peered":"2024-04-25T20:47:06.137933+0000","last_clean":"2024-04-25T20:47:06.137933+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:47:06.137933+0000","last_undegraded":"2024-04-25T20:47:06.137933+0000","last_fullsized":"2024-04-25T20:47:06.137933+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.139648+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:47:06.139648+0000","last_peered":"2024-04-25T20:47:06.139648+0000","last_clean":"2024-04-25T20:47:06.139648+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:47:06.139648+0000","last_undegraded":"2024-04-25T20:47:06.139648+0000","last_fullsized":"2024-04-25T20:47:06.139648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137586+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:47:06.137586+0000","last_peered":"2024-04-25T20:47:06.137586+0000","last_clean":"2024-04-25T20:47:06.137586+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:47:06.137586+0000","last_undegraded":"2024-04-25T20:47:06.137586+0000","last_fullsized":"2024-04-25T20:47:06.137586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750370+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:47:05.750370+0000","last_peered":"2024-04-25T20:47:05.750370+0000","last_clean":"2024-04-25T20:47:05.750370+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:47:05.750370+0000","last_undegraded":"2024-04-25T20:47:05.750370+0000","last_fullsized":"2024-04-25T20:47:05.750370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751536+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:47:05.751536+0000","last_peered":"2024-04-25T20:47:05.751536+0000","last_clean":"2024-04-25T20:47:05.751536+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:47:05.751536+0000","last_undegraded":"2024-04-25T20:47:05.751536+0000","last_fullsized":"2024-04-25T20:47:05.751536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752730+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:47:05.752730+0000","last_peered":"2024-04-25T20:47:05.752730+0000","last_clean":"2024-04-25T20:47:05.752730+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:47:05.752730+0000","last_undegraded":"2024-04-25T20:47:05.752730+0000","last_fullsized":"2024-04-25T20:47:05.752730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284027,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72710,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":605,"num_write":247,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":218130,"data_compressed":5466,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351017,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":483941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612653,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":1139694,"data_compressed":37940,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":483480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037816,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":483858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1077158,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462978,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":483588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":549225,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":484927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":549836,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149777,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":483022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888141,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":483449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724616,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1081344,"data_stored":1076054,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66867,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67478,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66851,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:48:32.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:48:32.869 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:33.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:33.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:32 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:48:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:48:33.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:32 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:48:33.128 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:32 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:48:34.040 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:33 smithi043 ceph-mon[29167]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:33 smithi195 ceph-mon[33250]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:33 smithi112 ceph-mon[32322]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:34.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 -- 172.21.15.43:0/966645377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 msgr2=0x7f7f7810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/966645377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f7810f8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800b0a0 tx=0x7f7f6800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 -- 172.21.15.43:0/966645377 shutdown_connections 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/966645377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f7810f8b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/966645377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78108a50 0x7f7f78108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/966645377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78102a90 0x7f7f78102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 -- 172.21.15.43:0/966645377 >> 172.21.15.43:0/966645377 conn(0x7f7f78079ba0 msgr2=0x7f7f78079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 -- 172.21.15.43:0/966645377 shutdown_connections 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.607+0000 7f7f7cc45700 1 -- 172.21.15.43:0/966645377 wait complete. 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 Processor -- start 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 -- start start 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 0x7f7f78199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:34.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78108a50 0x7f7f7819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78112e20 con 0x7f7f78103450 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78112ca0 con 0x7f7f78102a90 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7cc45700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78112fa0 con 0x7f7f78108a50 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f75d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f75d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56600/0 (socket says 172.21.15.43:56600) 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f7659c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 0x7f7f78199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f75d9b700 1 -- 172.21.15.43:0/1580497426 learned_addr learned my addr 172.21.15.43:0/1580497426 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.608+0000 7f7f76d9d700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78108a50 0x7f7f7819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:34.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 -- 172.21.15.43:0/1580497426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78108a50 msgr2=0x7f7f7819dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78108a50 0x7f7f7819dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 -- 172.21.15.43:0/1580497426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 msgr2=0x7f7f78199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 0x7f7f78199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 -- 172.21.15.43:0/1580497426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7819e3a0 con 0x7f7f78103450 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f7659c700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 0x7f7f78199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f75d9b700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000b530 tx=0x7f7f6000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60015020 con 0x7f7f78103450 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7819e690 con 0x7f7f78103450 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f60011d00 con 0x7f7f78103450 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60010e40 con 0x7f7f78103450 2024-04-25T20:48:34.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.609+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f781a5f10 con 0x7f7f78103450 2024-04-25T20:48:34.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.611+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f78069730 con 0x7f7f78103450 2024-04-25T20:48:34.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.612+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7f60018020 con 0x7f7f78103450 2024-04-25T20:48:34.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.612+0000 7f7f6f7fe700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 0x7f7f640a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:34.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.612+0000 7f7f7659c700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 0x7f7f640a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:34.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.612+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f7f600cfb20 con 0x7f7f78103450 2024-04-25T20:48:34.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.613+0000 7f7f7659c700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 0x7f7f640a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009de0 tx=0x7f7f70009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:34.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.617+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7f6001f020 con 0x7f7f78103450 2024-04-25T20:48:34.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.849+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f78062e80 con 0x7f7f640a3cd0 2024-04-25T20:48:34.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.858+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259005 (secure 0 0 0) 0x7f7f78062e80 con 0x7f7f640a3cd0 2024-04-25T20:48:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.862+0000 7f7f6f7fe700 1 -- 172.21.15.43:0/1580497426 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7f60098430 con 0x7f7f78103450 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 msgr2=0x7f7f640a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 0x7f7f640a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009de0 tx=0x7f7f70009190 comp rx=0 tx=0).stop 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 msgr2=0x7f7f781998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000b530 tx=0x7f7f6000b840 comp rx=0 tx=0).stop 2024-04-25T20:48:34.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 shutdown_connections 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7f640a3cd0 0x7f7f640a6190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f78108a50 0x7f7f7819dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7f78102a90 0x7f7f78199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 --2- 172.21.15.43:0/1580497426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f78103450 0x7f7f781998d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 >> 172.21.15.43:0/1580497426 conn(0x7f7f78079ba0 msgr2=0x7f7f781017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 shutdown_connections 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:34.863+0000 7f7f7cc45700 1 -- 172.21.15.43:0/1580497426 wait complete. 2024-04-25T20:48:34.865 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:48:35.535 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-04-25T20:48:34.696329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663312,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1227,"num_read_kb":744,"num_write":430,"num_write_kb":3081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390548,"kb_used_data":12240,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551276,"statfs":{"total":1151940427776,"available":1151540506624,"internally_reserved":0,"allocated":12533760,"data_stored":7778232,"data_compressed":113820,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002849"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753228+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:47:05.753228+0000","last_peered":"2024-04-25T20:47:05.753228+0000","last_clean":"2024-04-25T20:47:05.753228+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:47:05.753228+0000","last_undegraded":"2024-04-25T20:47:05.753228+0000","last_fullsized":"2024-04-25T20:47:05.753228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754516+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:47:05.754516+0000","last_peered":"2024-04-25T20:47:05.754516+0000","last_clean":"2024-04-25T20:47:05.754516+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:47:05.754516+0000","last_undegraded":"2024-04-25T20:47:05.754516+0000","last_fullsized":"2024-04-25T20:47:05.754516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754170+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:47:05.754170+0000","last_peered":"2024-04-25T20:47:05.754170+0000","last_clean":"2024-04-25T20:47:05.754170+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:47:05.754170+0000","last_undegraded":"2024-04-25T20:47:05.754170+0000","last_fullsized":"2024-04-25T20:47:05.754170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.919088+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:47:05.919088+0000","last_peered":"2024-04-25T20:47:05.919088+0000","last_clean":"2024-04-25T20:47:05.919088+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:47:05.919088+0000","last_undegraded":"2024-04-25T20:47:05.919088+0000","last_fullsized":"2024-04-25T20:47:05.919088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756158+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:47:05.756158+0000","last_peered":"2024-04-25T20:47:05.756158+0000","last_clean":"2024-04-25T20:47:05.756158+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:47:05.756158+0000","last_undegraded":"2024-04-25T20:47:05.756158+0000","last_fullsized":"2024-04-25T20:47:05.756158+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.757617+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:47:05.757617+0000","last_peered":"2024-04-25T20:47:05.757617+0000","last_clean":"2024-04-25T20:47:05.757617+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:47:05.757617+0000","last_undegraded":"2024-04-25T20:47:05.757617+0000","last_fullsized":"2024-04-25T20:47:05.757617+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754188+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:47:05.754188+0000","last_peered":"2024-04-25T20:47:05.754188+0000","last_clean":"2024-04-25T20:47:05.754188+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:47:05.754188+0000","last_undegraded":"2024-04-25T20:47:05.754188+0000","last_fullsized":"2024-04-25T20:47:05.754188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137789+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:47:06.137789+0000","last_peered":"2024-04-25T20:47:06.137789+0000","last_clean":"2024-04-25T20:47:06.137789+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:47:06.137789+0000","last_undegraded":"2024-04-25T20:47:06.137789+0000","last_fullsized":"2024-04-25T20:47:06.137789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750560+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:47:05.750560+0000","last_peered":"2024-04-25T20:47:05.750560+0000","last_clean":"2024-04-25T20:47:05.750560+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:47:05.750560+0000","last_undegraded":"2024-04-25T20:47:05.750560+0000","last_fullsized":"2024-04-25T20:47:05.750560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752879+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:47:05.752879+0000","last_peered":"2024-04-25T20:47:05.752879+0000","last_clean":"2024-04-25T20:47:05.752879+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:47:05.752879+0000","last_undegraded":"2024-04-25T20:47:05.752879+0000","last_fullsized":"2024-04-25T20:47:05.752879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754735+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:47:05.754735+0000","last_peered":"2024-04-25T20:47:05.754735+0000","last_clean":"2024-04-25T20:47:05.754735+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:47:05.754735+0000","last_undegraded":"2024-04-25T20:47:05.754735+0000","last_fullsized":"2024-04-25T20:47:05.754735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918857+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:47:05.918857+0000","last_peered":"2024-04-25T20:47:05.918857+0000","last_clean":"2024-04-25T20:47:05.918857+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:47:05.918857+0000","last_undegraded":"2024-04-25T20:47:05.918857+0000","last_fullsized":"2024-04-25T20:47:05.918857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751424+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:47:05.751424+0000","last_peered":"2024-04-25T20:47:05.751424+0000","last_clean":"2024-04-25T20:47:05.751424+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:47:05.751424+0000","last_undegraded":"2024-04-25T20:47:05.751424+0000","last_fullsized":"2024-04-25T20:47:05.751424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753402+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:47:05.753402+0000","last_peered":"2024-04-25T20:47:05.753402+0000","last_clean":"2024-04-25T20:47:05.753402+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:47:05.753402+0000","last_undegraded":"2024-04-25T20:47:05.753402+0000","last_fullsized":"2024-04-25T20:47:05.753402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753232+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:47:05.753232+0000","last_peered":"2024-04-25T20:47:05.753232+0000","last_clean":"2024-04-25T20:47:05.753232+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:47:05.753232+0000","last_undegraded":"2024-04-25T20:47:05.753232+0000","last_fullsized":"2024-04-25T20:47:05.753232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749984+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:47:05.749984+0000","last_peered":"2024-04-25T20:47:05.749984+0000","last_clean":"2024-04-25T20:47:05.749984+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:47:05.749984+0000","last_undegraded":"2024-04-25T20:47:05.749984+0000","last_fullsized":"2024-04-25T20:47:05.749984+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753319+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:47:05.753319+0000","last_peered":"2024-04-25T20:47:05.753319+0000","last_clean":"2024-04-25T20:47:05.753319+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:47:05.753319+0000","last_undegraded":"2024-04-25T20:47:05.753319+0000","last_fullsized":"2024-04-25T20:47:05.753319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750440+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:47:05.750440+0000","last_peered":"2024-04-25T20:47:05.750440+0000","last_clean":"2024-04-25T20:47:05.750440+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:47:05.750440+0000","last_undegraded":"2024-04-25T20:47:05.750440+0000","last_fullsized":"2024-04-25T20:47:05.750440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":145,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:29.646594+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:48:29.646594+0000","last_peered":"2024-04-25T20:48:29.646594+0000","last_clean":"2024-04-25T20:48:29.646594+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:48:29.646594+0000","last_undegraded":"2024-04-25T20:48:29.646594+0000","last_fullsized":"2024-04-25T20:48:29.646594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138029+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:47:06.138029+0000","last_peered":"2024-04-25T20:47:06.138029+0000","last_clean":"2024-04-25T20:47:06.138029+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:47:06.138029+0000","last_undegraded":"2024-04-25T20:47:06.138029+0000","last_fullsized":"2024-04-25T20:47:06.138029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138221+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:47:06.138221+0000","last_peered":"2024-04-25T20:47:06.138221+0000","last_clean":"2024-04-25T20:47:06.138221+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:47:06.138221+0000","last_undegraded":"2024-04-25T20:47:06.138221+0000","last_fullsized":"2024-04-25T20:47:06.138221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754515+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:47:05.754515+0000","last_peered":"2024-04-25T20:47:05.754515+0000","last_clean":"2024-04-25T20:47:05.754515+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:47:05.754515+0000","last_undegraded":"2024-04-25T20:47:05.754515+0000","last_fullsized":"2024-04-25T20:47:05.754515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756813+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:47:05.756813+0000","last_peered":"2024-04-25T20:47:05.756813+0000","last_clean":"2024-04-25T20:47:05.756813+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:47:05.756813+0000","last_undegraded":"2024-04-25T20:47:05.756813+0000","last_fullsized":"2024-04-25T20:47:05.756813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750745+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:47:05.750745+0000","last_peered":"2024-04-25T20:47:05.750745+0000","last_clean":"2024-04-25T20:47:05.750745+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:47:05.750745+0000","last_undegraded":"2024-04-25T20:47:05.750745+0000","last_fullsized":"2024-04-25T20:47:05.750745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756533+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:47:05.756533+0000","last_peered":"2024-04-25T20:47:05.756533+0000","last_clean":"2024-04-25T20:47:05.756533+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:47:05.756533+0000","last_undegraded":"2024-04-25T20:47:05.756533+0000","last_fullsized":"2024-04-25T20:47:05.756533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754423+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:47:05.754423+0000","last_peered":"2024-04-25T20:47:05.754423+0000","last_clean":"2024-04-25T20:47:05.754423+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:47:05.754423+0000","last_undegraded":"2024-04-25T20:47:05.754423+0000","last_fullsized":"2024-04-25T20:47:05.754423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:29.648294+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:48:29.648294+0000","last_peered":"2024-04-25T20:48:29.648294+0000","last_clean":"2024-04-25T20:48:29.648294+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:48:29.648294+0000","last_undegraded":"2024-04-25T20:48:29.648294+0000","last_fullsized":"2024-04-25T20:48:29.648294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755999+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:47:05.755999+0000","last_peered":"2024-04-25T20:47:05.755999+0000","last_clean":"2024-04-25T20:47:05.755999+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:47:05.755999+0000","last_undegraded":"2024-04-25T20:47:05.755999+0000","last_fullsized":"2024-04-25T20:47:05.755999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752327+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:47:05.752327+0000","last_peered":"2024-04-25T20:47:05.752327+0000","last_clean":"2024-04-25T20:47:05.752327+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:47:05.752327+0000","last_undegraded":"2024-04-25T20:47:05.752327+0000","last_fullsized":"2024-04-25T20:47:05.752327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920027+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:47:05.920027+0000","last_peered":"2024-04-25T20:47:05.920027+0000","last_clean":"2024-04-25T20:47:05.920027+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:47:05.920027+0000","last_undegraded":"2024-04-25T20:47:05.920027+0000","last_fullsized":"2024-04-25T20:47:05.920027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751613+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:47:05.751613+0000","last_peered":"2024-04-25T20:47:05.751613+0000","last_clean":"2024-04-25T20:47:05.751613+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:47:05.751613+0000","last_undegraded":"2024-04-25T20:47:05.751613+0000","last_fullsized":"2024-04-25T20:47:05.751613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137900+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:47:06.137900+0000","last_peered":"2024-04-25T20:47:06.137900+0000","last_clean":"2024-04-25T20:47:06.137900+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:47:06.137900+0000","last_undegraded":"2024-04-25T20:47:06.137900+0000","last_fullsized":"2024-04-25T20:47:06.137900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754009+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:47:05.754009+0000","last_peered":"2024-04-25T20:47:05.754009+0000","last_clean":"2024-04-25T20:47:05.754009+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:47:05.754009+0000","last_undegraded":"2024-04-25T20:47:05.754009+0000","last_fullsized":"2024-04-25T20:47:05.754009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.749633+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:47:05.749633+0000","last_peered":"2024-04-25T20:47:05.749633+0000","last_clean":"2024-04-25T20:47:05.749633+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:47:05.749633+0000","last_undegraded":"2024-04-25T20:47:05.749633+0000","last_fullsized":"2024-04-25T20:47:05.749633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":240,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:30.648853+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:48:30.648853+0000","last_peered":"2024-04-25T20:48:30.648853+0000","last_clean":"2024-04-25T20:48:30.648853+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:48:30.648853+0000","last_undegraded":"2024-04-25T20:48:30.648853+0000","last_fullsized":"2024-04-25T20:48:30.648853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":210,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750667+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:47:05.750667+0000","last_peered":"2024-04-25T20:47:05.750667+0000","last_clean":"2024-04-25T20:47:05.750667+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:47:05.750667+0000","last_undegraded":"2024-04-25T20:47:05.750667+0000","last_fullsized":"2024-04-25T20:47:05.750667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754768+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:47:05.754768+0000","last_peered":"2024-04-25T20:47:05.754768+0000","last_clean":"2024-04-25T20:47:05.754768+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:47:05.754768+0000","last_undegraded":"2024-04-25T20:47:05.754768+0000","last_fullsized":"2024-04-25T20:47:05.754768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754394+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:47:05.754394+0000","last_peered":"2024-04-25T20:47:05.754394+0000","last_clean":"2024-04-25T20:47:05.754394+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:47:05.754394+0000","last_undegraded":"2024-04-25T20:47:05.754394+0000","last_fullsized":"2024-04-25T20:47:05.754394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754546+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:47:05.754546+0000","last_peered":"2024-04-25T20:47:05.754546+0000","last_clean":"2024-04-25T20:47:05.754546+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:47:05.754546+0000","last_undegraded":"2024-04-25T20:47:05.754546+0000","last_fullsized":"2024-04-25T20:47:05.754546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750258+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:47:05.750258+0000","last_peered":"2024-04-25T20:47:05.750258+0000","last_clean":"2024-04-25T20:47:05.750258+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:47:05.750258+0000","last_undegraded":"2024-04-25T20:47:05.750258+0000","last_fullsized":"2024-04-25T20:47:05.750258+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":278,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:30.648901+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:48:30.648901+0000","last_peered":"2024-04-25T20:48:30.648901+0000","last_clean":"2024-04-25T20:48:30.648901+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:48:30.648901+0000","last_undegraded":"2024-04-25T20:48:30.648901+0000","last_fullsized":"2024-04-25T20:48:30.648901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64724,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":172,"num_write":35,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756435+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:47:05.756435+0000","last_peered":"2024-04-25T20:47:05.756435+0000","last_clean":"2024-04-25T20:47:05.756435+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:47:05.756435+0000","last_undegraded":"2024-04-25T20:47:05.756435+0000","last_fullsized":"2024-04-25T20:47:05.756435+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750404+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:47:05.750404+0000","last_peered":"2024-04-25T20:47:05.750404+0000","last_clean":"2024-04-25T20:47:05.750404+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:47:05.750404+0000","last_undegraded":"2024-04-25T20:47:05.750404+0000","last_fullsized":"2024-04-25T20:47:05.750404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751149+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:47:05.751149+0000","last_peered":"2024-04-25T20:47:05.751149+0000","last_clean":"2024-04-25T20:47:05.751149+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:47:05.751149+0000","last_undegraded":"2024-04-25T20:47:05.751149+0000","last_fullsized":"2024-04-25T20:47:05.751149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753879+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:47:05.753879+0000","last_peered":"2024-04-25T20:47:05.753879+0000","last_clean":"2024-04-25T20:47:05.753879+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:47:05.753879+0000","last_undegraded":"2024-04-25T20:47:05.753879+0000","last_fullsized":"2024-04-25T20:47:05.753879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754629+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:47:05.754629+0000","last_peered":"2024-04-25T20:47:05.754629+0000","last_clean":"2024-04-25T20:47:05.754629+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:47:05.754629+0000","last_undegraded":"2024-04-25T20:47:05.754629+0000","last_fullsized":"2024-04-25T20:47:05.754629+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:28.712692+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:48:28.712692+0000","last_peered":"2024-04-25T20:48:28.712692+0000","last_clean":"2024-04-25T20:48:28.712692+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:48:28.712692+0000","last_undegraded":"2024-04-25T20:48:28.712692+0000","last_fullsized":"2024-04-25T20:48:28.712692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754123+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:47:05.754123+0000","last_peered":"2024-04-25T20:47:05.754123+0000","last_clean":"2024-04-25T20:47:05.754123+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:47:05.754123+0000","last_undegraded":"2024-04-25T20:47:05.754123+0000","last_fullsized":"2024-04-25T20:47:05.754123+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755855+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:47:05.755855+0000","last_peered":"2024-04-25T20:47:05.755855+0000","last_clean":"2024-04-25T20:47:05.755855+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:47:05.755855+0000","last_undegraded":"2024-04-25T20:47:05.755855+0000","last_fullsized":"2024-04-25T20:47:05.755855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753858+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:47:05.753858+0000","last_peered":"2024-04-25T20:47:05.753858+0000","last_clean":"2024-04-25T20:47:05.753858+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:47:05.753858+0000","last_undegraded":"2024-04-25T20:47:05.753858+0000","last_fullsized":"2024-04-25T20:47:05.753858+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756828+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:47:05.756828+0000","last_peered":"2024-04-25T20:47:05.756828+0000","last_clean":"2024-04-25T20:47:05.756828+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:47:05.756828+0000","last_undegraded":"2024-04-25T20:47:05.756828+0000","last_fullsized":"2024-04-25T20:47:05.756828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.753110+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:47:05.753110+0000","last_peered":"2024-04-25T20:47:05.753110+0000","last_clean":"2024-04-25T20:47:05.753110+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:47:05.753110+0000","last_undegraded":"2024-04-25T20:47:05.753110+0000","last_fullsized":"2024-04-25T20:47:05.753110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750050+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:47:05.750050+0000","last_peered":"2024-04-25T20:47:05.750050+0000","last_clean":"2024-04-25T20:47:05.750050+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:47:05.750050+0000","last_undegraded":"2024-04-25T20:47:05.750050+0000","last_fullsized":"2024-04-25T20:47:05.750050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752590+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:47:05.752590+0000","last_peered":"2024-04-25T20:47:05.752590+0000","last_clean":"2024-04-25T20:47:05.752590+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:47:05.752590+0000","last_undegraded":"2024-04-25T20:47:05.752590+0000","last_fullsized":"2024-04-25T20:47:05.752590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'6","reported_seq":141,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:30.648798+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:48:30.648798+0000","last_peered":"2024-04-25T20:48:30.648798+0000","last_clean":"2024-04-25T20:48:30.648798+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:48:30.648798+0000","last_undegraded":"2024-04-25T20:48:30.648798+0000","last_fullsized":"2024-04-25T20:48:30.648798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756206+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:47:05.756206+0000","last_peered":"2024-04-25T20:47:05.756206+0000","last_clean":"2024-04-25T20:47:05.756206+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:47:05.756206+0000","last_undegraded":"2024-04-25T20:47:05.756206+0000","last_fullsized":"2024-04-25T20:47:05.756206+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.920287+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:47:05.920287+0000","last_peered":"2024-04-25T20:47:05.920287+0000","last_clean":"2024-04-25T20:47:05.920287+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:47:05.920287+0000","last_undegraded":"2024-04-25T20:47:05.920287+0000","last_fullsized":"2024-04-25T20:47:05.920287+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":140,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:31.717154+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:48:31.717154+0000","last_peered":"2024-04-25T20:48:31.717154+0000","last_clean":"2024-04-25T20:48:31.717154+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:48:31.717154+0000","last_undegraded":"2024-04-25T20:48:31.717154+0000","last_fullsized":"2024-04-25T20:48:31.717154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137915+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:47:06.137915+0000","last_peered":"2024-04-25T20:47:06.137915+0000","last_clean":"2024-04-25T20:47:06.137915+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:47:06.137915+0000","last_undegraded":"2024-04-25T20:47:06.137915+0000","last_fullsized":"2024-04-25T20:47:06.137915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918914+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:47:05.918914+0000","last_peered":"2024-04-25T20:47:05.918914+0000","last_clean":"2024-04-25T20:47:05.918914+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:47:05.918914+0000","last_undegraded":"2024-04-25T20:47:05.918914+0000","last_fullsized":"2024-04-25T20:47:05.918914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":358,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754315+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:47:05.754315+0000","last_peered":"2024-04-25T20:47:05.754315+0000","last_clean":"2024-04-25T20:47:05.754315+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:47:05.754315+0000","last_undegraded":"2024-04-25T20:47:05.754315+0000","last_fullsized":"2024-04-25T20:47:05.754315+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755575+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:47:05.755575+0000","last_peered":"2024-04-25T20:47:05.755575+0000","last_clean":"2024-04-25T20:47:05.755575+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:47:05.755575+0000","last_undegraded":"2024-04-25T20:47:05.755575+0000","last_fullsized":"2024-04-25T20:47:05.755575+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754439+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:47:05.754439+0000","last_peered":"2024-04-25T20:47:05.754439+0000","last_clean":"2024-04-25T20:47:05.754439+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:47:05.754439+0000","last_undegraded":"2024-04-25T20:47:05.754439+0000","last_fullsized":"2024-04-25T20:47:05.754439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.756678+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:47:05.756678+0000","last_peered":"2024-04-25T20:47:05.756678+0000","last_clean":"2024-04-25T20:47:05.756678+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:47:05.756678+0000","last_undegraded":"2024-04-25T20:47:05.756678+0000","last_fullsized":"2024-04-25T20:47:05.756678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751645+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:47:05.751645+0000","last_peered":"2024-04-25T20:47:05.751645+0000","last_clean":"2024-04-25T20:47:05.751645+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:47:05.751645+0000","last_undegraded":"2024-04-25T20:47:05.751645+0000","last_fullsized":"2024-04-25T20:47:05.751645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:09.498024+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:47:09.498024+0000","last_peered":"2024-04-25T20:47:09.498024+0000","last_clean":"2024-04-25T20:47:09.498024+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:47:09.498024+0000","last_undegraded":"2024-04-25T20:47:09.498024+0000","last_fullsized":"2024-04-25T20:47:09.498024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.138035+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:47:06.138035+0000","last_peered":"2024-04-25T20:47:06.138035+0000","last_clean":"2024-04-25T20:47:06.138035+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:47:06.138035+0000","last_undegraded":"2024-04-25T20:47:06.138035+0000","last_fullsized":"2024-04-25T20:47:06.138035+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.918866+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:47:05.918866+0000","last_peered":"2024-04-25T20:47:05.918866+0000","last_clean":"2024-04-25T20:47:05.918866+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:47:05.918866+0000","last_undegraded":"2024-04-25T20:47:05.918866+0000","last_fullsized":"2024-04-25T20:47:05.918866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754209+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:47:05.754209+0000","last_peered":"2024-04-25T20:47:05.754209+0000","last_clean":"2024-04-25T20:47:05.754209+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:47:05.754209+0000","last_undegraded":"2024-04-25T20:47:05.754209+0000","last_fullsized":"2024-04-25T20:47:05.754209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.758971+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:47:05.758971+0000","last_peered":"2024-04-25T20:47:05.758971+0000","last_clean":"2024-04-25T20:47:05.758971+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:47:05.758971+0000","last_undegraded":"2024-04-25T20:47:05.758971+0000","last_fullsized":"2024-04-25T20:47:05.758971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.755850+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:47:05.755850+0000","last_peered":"2024-04-25T20:47:05.755850+0000","last_clean":"2024-04-25T20:47:05.755850+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:47:05.755850+0000","last_undegraded":"2024-04-25T20:47:05.755850+0000","last_fullsized":"2024-04-25T20:47:05.755850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137733+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:47:06.137733+0000","last_peered":"2024-04-25T20:47:06.137733+0000","last_clean":"2024-04-25T20:47:06.137733+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:47:06.137733+0000","last_undegraded":"2024-04-25T20:47:06.137733+0000","last_fullsized":"2024-04-25T20:47:06.137733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752868+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:47:05.752868+0000","last_peered":"2024-04-25T20:47:05.752868+0000","last_clean":"2024-04-25T20:47:05.752868+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:47:05.752868+0000","last_undegraded":"2024-04-25T20:47:05.752868+0000","last_fullsized":"2024-04-25T20:47:05.752868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750196+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:47:05.750196+0000","last_peered":"2024-04-25T20:47:05.750196+0000","last_clean":"2024-04-25T20:47:05.750196+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:47:05.750196+0000","last_undegraded":"2024-04-25T20:47:05.750196+0000","last_fullsized":"2024-04-25T20:47:05.750196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137753+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:47:06.137753+0000","last_peered":"2024-04-25T20:47:06.137753+0000","last_clean":"2024-04-25T20:47:06.137753+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:47:06.137753+0000","last_undegraded":"2024-04-25T20:47:06.137753+0000","last_fullsized":"2024-04-25T20:47:06.137753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.761066+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:47:05.761066+0000","last_peered":"2024-04-25T20:47:05.761066+0000","last_clean":"2024-04-25T20:47:05.761066+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:47:05.761066+0000","last_undegraded":"2024-04-25T20:47:05.761066+0000","last_fullsized":"2024-04-25T20:47:05.761066+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754473+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:47:05.754473+0000","last_peered":"2024-04-25T20:47:05.754473+0000","last_clean":"2024-04-25T20:47:05.754473+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:47:05.754473+0000","last_undegraded":"2024-04-25T20:47:05.754473+0000","last_fullsized":"2024-04-25T20:47:05.754473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'6","reported_seq":139,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:48:28.646583+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:48:28.646583+0000","last_peered":"2024-04-25T20:48:28.646583+0000","last_clean":"2024-04-25T20:48:28.646583+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:48:28.646583+0000","last_undegraded":"2024-04-25T20:48:28.646583+0000","last_fullsized":"2024-04-25T20:48:28.646583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754966+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:47:05.754966+0000","last_peered":"2024-04-25T20:47:05.754966+0000","last_clean":"2024-04-25T20:47:05.754966+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:47:05.754966+0000","last_undegraded":"2024-04-25T20:47:05.754966+0000","last_fullsized":"2024-04-25T20:47:05.754966+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754281+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:47:05.754281+0000","last_peered":"2024-04-25T20:47:05.754281+0000","last_clean":"2024-04-25T20:47:05.754281+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:47:05.754281+0000","last_undegraded":"2024-04-25T20:47:05.754281+0000","last_fullsized":"2024-04-25T20:47:05.754281+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754715+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:47:05.754715+0000","last_peered":"2024-04-25T20:47:05.754715+0000","last_clean":"2024-04-25T20:47:05.754715+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:47:05.754715+0000","last_undegraded":"2024-04-25T20:47:05.754715+0000","last_fullsized":"2024-04-25T20:47:05.754715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751385+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:47:05.751385+0000","last_peered":"2024-04-25T20:47:05.751385+0000","last_clean":"2024-04-25T20:47:05.751385+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:47:05.751385+0000","last_undegraded":"2024-04-25T20:47:05.751385+0000","last_fullsized":"2024-04-25T20:47:05.751385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754916+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:47:05.754916+0000","last_peered":"2024-04-25T20:47:05.754916+0000","last_clean":"2024-04-25T20:47:05.754916+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:47:05.754916+0000","last_undegraded":"2024-04-25T20:47:05.754916+0000","last_fullsized":"2024-04-25T20:47:05.754916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752970+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:47:05.752970+0000","last_peered":"2024-04-25T20:47:05.752970+0000","last_clean":"2024-04-25T20:47:05.752970+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:47:05.752970+0000","last_undegraded":"2024-04-25T20:47:05.752970+0000","last_fullsized":"2024-04-25T20:47:05.752970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750673+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:47:05.750673+0000","last_peered":"2024-04-25T20:47:05.750673+0000","last_clean":"2024-04-25T20:47:05.750673+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:47:05.750673+0000","last_undegraded":"2024-04-25T20:47:05.750673+0000","last_fullsized":"2024-04-25T20:47:05.750673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750126+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:47:05.750126+0000","last_peered":"2024-04-25T20:47:05.750126+0000","last_clean":"2024-04-25T20:47:05.750126+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:47:05.750126+0000","last_undegraded":"2024-04-25T20:47:05.750126+0000","last_fullsized":"2024-04-25T20:47:05.750126+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.754080+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:47:05.754080+0000","last_peered":"2024-04-25T20:47:05.754080+0000","last_clean":"2024-04-25T20:47:05.754080+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:47:05.754080+0000","last_undegraded":"2024-04-25T20:47:05.754080+0000","last_fullsized":"2024-04-25T20:47:05.754080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751248+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:47:05.751248+0000","last_peered":"2024-04-25T20:47:05.751248+0000","last_clean":"2024-04-25T20:47:05.751248+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:47:05.751248+0000","last_undegraded":"2024-04-25T20:47:05.751248+0000","last_fullsized":"2024-04-25T20:47:05.751248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752899+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:47:05.752899+0000","last_peered":"2024-04-25T20:47:05.752899+0000","last_clean":"2024-04-25T20:47:05.752899+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:47:05.752899+0000","last_undegraded":"2024-04-25T20:47:05.752899+0000","last_fullsized":"2024-04-25T20:47:05.752899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750546+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:47:05.750546+0000","last_peered":"2024-04-25T20:47:05.750546+0000","last_clean":"2024-04-25T20:47:05.750546+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:47:05.750546+0000","last_undegraded":"2024-04-25T20:47:05.750546+0000","last_fullsized":"2024-04-25T20:47:05.750546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137933+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:47:06.137933+0000","last_peered":"2024-04-25T20:47:06.137933+0000","last_clean":"2024-04-25T20:47:06.137933+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:47:06.137933+0000","last_undegraded":"2024-04-25T20:47:06.137933+0000","last_fullsized":"2024-04-25T20:47:06.137933+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.139648+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:47:06.139648+0000","last_peered":"2024-04-25T20:47:06.139648+0000","last_clean":"2024-04-25T20:47:06.139648+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:47:06.139648+0000","last_undegraded":"2024-04-25T20:47:06.139648+0000","last_fullsized":"2024-04-25T20:47:06.139648+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:06.137586+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:47:06.137586+0000","last_peered":"2024-04-25T20:47:06.137586+0000","last_clean":"2024-04-25T20:47:06.137586+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:47:06.137586+0000","last_undegraded":"2024-04-25T20:47:06.137586+0000","last_fullsized":"2024-04-25T20:47:06.137586+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.750370+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:47:05.750370+0000","last_peered":"2024-04-25T20:47:05.750370+0000","last_clean":"2024-04-25T20:47:05.750370+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:47:05.750370+0000","last_undegraded":"2024-04-25T20:47:05.750370+0000","last_fullsized":"2024-04-25T20:47:05.750370+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.751536+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:47:05.751536+0000","last_peered":"2024-04-25T20:47:05.751536+0000","last_clean":"2024-04-25T20:47:05.751536+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:47:05.751536+0000","last_undegraded":"2024-04-25T20:47:05.751536+0000","last_fullsized":"2024-04-25T20:47:05.751536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T20:47:05.752730+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:47:05.752730+0000","last_peered":"2024-04-25T20:47:05.752730+0000","last_clean":"2024-04-25T20:47:05.752730+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:47:05.752730+0000","last_undegraded":"2024-04-25T20:47:05.752730+0000","last_fullsized":"2024-04-25T20:47:05.752730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284027,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72710,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1091,"num_read_kb":625,"num_write":247,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":218130,"data_compressed":5466,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351018,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":483941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":1139694,"data_compressed":37940,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":483480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037817,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":483858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":1077158,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462979,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":483588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":549225,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":484927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":549836,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149778,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":483022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888141,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":483449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724617,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1081344,"data_stored":1076054,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66867,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":67478,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":66851,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:48:35.539 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T20:48:35.539 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T20:48:35.539 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T20:48:35.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T20:48:35.846 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:36.110 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:35 smithi043 ceph-mon[29167]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:36.110 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:35 smithi043 ceph-mon[29167]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:36.111 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:35 smithi043 ceph-mon[29167]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T20:48:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:35 smithi195 ceph-mon[33250]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:35 smithi195 ceph-mon[33250]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:35 smithi195 ceph-mon[33250]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T20:48:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:35 smithi112 ceph-mon[32322]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:35 smithi112 ceph-mon[32322]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:48:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:35 smithi112 ceph-mon[32322]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/4080686566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0101940 msgr2=0x7fd4b0101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/4080686566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0101940 0x7fd4b0101dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009990 tx=0x7fd4ac009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/4080686566 shutdown_connections 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/4080686566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 0x7fd4b0107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/4080686566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0102300 0x7fd4b010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/4080686566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0101940 0x7fd4b0101dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/4080686566 >> 172.21.15.43:0/4080686566 conn(0x7fd4b00788f0 msgr2=0x7fd4b0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/4080686566 shutdown_connections 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.573+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/4080686566 wait complete. 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 Processor -- start 2024-04-25T20:48:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 -- start start 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 0x7fd4b019dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 0x7fd4b0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0111c90 con 0x7fd4b0102300 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0111b10 con 0x7fd4b0101940 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b7b8c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0111e10 con 0x7fd4b0107990 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b5127700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b5127700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33132/0 (socket says 172.21.15.43:33132) 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.574+0000 7fd4b5127700 1 -- 172.21.15.43:0/2984333486 learned_addr learned my addr 172.21.15.43:0/2984333486 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5928700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 0x7fd4b019dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 -- 172.21.15.43:0/2984333486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 msgr2=0x7fd4b0199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b6129700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 0x7fd4b0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 0x7fd4b0199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 -- 172.21.15.43:0/2984333486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 msgr2=0x7fd4b019dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 0x7fd4b019dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 -- 172.21.15.43:0/2984333486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b0199b00 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5928700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 0x7fd4b019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b5127700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac027070 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b0199d90 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4ac0041e0 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00f460 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.575+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01a5d10 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.576+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b0069730 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.577+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd4ac02a070 con 0x7fd4b0102300 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.578+0000 7fd4a2ffd700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 0x7fd49c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.578+0000 7fd4b5928700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 0x7fd49c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.578+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fd4ac0d1290 con 0x7fd4b0102300 2024-04-25T20:48:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.579+0000 7fd4b5928700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 0x7fd49c0a6100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007900 tx=0x7fd4a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.583+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4ac013070 con 0x7fd4b0102300 2024-04-25T20:48:37.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.837+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4b01a5ee0 con 0x7fd4b0102300 2024-04-25T20:48:37.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.837+0000 7fd4a2ffd700 1 -- 172.21.15.43:0/2984333486 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd4ac09dd10 con 0x7fd4b0102300 2024-04-25T20:48:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:37.838 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T20:48:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 msgr2=0x7fd49c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 0x7fd49c0a6100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007900 tx=0x7fd4a4008040 comp rx=0 tx=0).stop 2024-04-25T20:48:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 msgr2=0x7fd4b019e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac0037a0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 shutdown_connections 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd49c0a3c40 0x7fd49c0a6100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4b0107990 0x7fd4b0199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4b0101940 0x7fd4b019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 --2- 172.21.15.43:0/2984333486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4b0102300 0x7fd4b019e320 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.839+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 >> 172.21.15.43:0/2984333486 conn(0x7fd4b00788f0 msgr2=0x7fd4b00ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.840+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 shutdown_connections 2024-04-25T20:48:37.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:37.840+0000 7fd4b7b8c700 1 -- 172.21.15.43:0/2984333486 wait complete. 2024-04-25T20:48:38.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:37 smithi043 ceph-mon[29167]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-25T20:48:38.157 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:37 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2984333486' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T20:48:38.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:37 smithi195 ceph-mon[33250]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-25T20:48:38.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:37 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2984333486' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T20:48:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:37 smithi112 ceph-mon[32322]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-04-25T20:48:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:37 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2984333486' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T20:48:38.481 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T20:48:38.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:48:38.746 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:40.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:39 smithi043 ceph-mon[29167]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:39 smithi195 ceph-mon[33250]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:39 smithi112 ceph-mon[32322]: pgmap v368: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:40.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 -- 172.21.15.43:0/1026530022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 msgr2=0x7f8850102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 --2- 172.21.15.43:0/1026530022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f8850102110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f883c009990 tx=0x7f883c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 -- 172.21.15.43:0/1026530022 shutdown_connections 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 --2- 172.21.15.43:0/1026530022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850102650 0x7f885010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 --2- 172.21.15.43:0/1026530022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850106930 0x7f8850106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 --2- 172.21.15.43:0/1026530022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f8850102110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 -- 172.21.15.43:0/1026530022 >> 172.21.15.43:0/1026530022 conn(0x7f88500777b0 msgr2=0x7f8850077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 -- 172.21.15.43:0/1026530022 shutdown_connections 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.501+0000 7f8856cee700 1 -- 172.21.15.43:0/1026530022 wait complete. 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 Processor -- start 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 -- start start 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850102650 0x7f885019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:40.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850106930 0x7f88501a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8850111c90 con 0x7f8850101c90 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8850111b10 con 0x7f8850102650 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8856cee700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8850111e10 con 0x7f8850106930 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33154/0 (socket says 172.21.15.43:33154) 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 -- 172.21.15.43:0/988124510 learned_addr learned my addr 172.21.15.43:0/988124510 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f885528b700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850106930 0x7f88501a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f884ffff700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850102650 0x7f885019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 -- 172.21.15.43:0/988124510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850106930 msgr2=0x7f88501a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850106930 0x7f88501a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 -- 172.21.15.43:0/988124510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850102650 msgr2=0x7f885019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850102650 0x7f885019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.502+0000 7f8854a8a700 1 -- 172.21.15.43:0/988124510 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88501a55d0 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f8854a8a700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f884400d980 tx=0x7f884400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844017030 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f88440044f0 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88501a5800 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844003aa0 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.503+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88501a5d10 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.504+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88501030b0 con 0x7f8850101c90 2024-04-25T20:48:40.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.505+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f884401a070 con 0x7f8850101c90 2024-04-25T20:48:40.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.506+0000 7f884dffb700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 0x7f88400a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:40.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.506+0000 7f884ffff700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 0x7f88400a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:40.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.506+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f88440cfca0 con 0x7f8850101c90 2024-04-25T20:48:40.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.506+0000 7f884ffff700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 0x7f88400a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f883c006010 tx=0x7f883c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:40.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.510+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f884409c690 con 0x7f8850101c90 2024-04-25T20:48:40.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.766+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f885006b760 con 0x7f8850101c90 2024-04-25T20:48:40.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.766+0000 7f884dffb700 1 -- 172.21.15.43:0/988124510 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7f884409bf90 con 0x7f8850101c90 2024-04-25T20:48:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:40.767 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.768+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 msgr2=0x7f88400a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 0x7f88400a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f883c006010 tx=0x7f883c00b540 comp rx=0 tx=0).stop 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 msgr2=0x7f885019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f884400d980 tx=0x7f884400dc90 comp rx=0 tx=0).stop 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 shutdown_connections 2024-04-25T20:48:40.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f88400a3c40 0x7f88400a6100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850106930 0x7f88501a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8850101c90 0x7f885019a010 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 --2- 172.21.15.43:0/988124510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8850102650 0x7f885019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 >> 172.21.15.43:0/988124510 conn(0x7f88500777b0 msgr2=0x7f88500ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 shutdown_connections 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:40.769+0000 7f8856cee700 1 -- 172.21.15.43:0/988124510 wait complete. 2024-04-25T20:48:40.770 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:48:41.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:40 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/988124510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:41.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:40 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/988124510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:41.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:40 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/988124510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:41.500 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:48:41.756 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:42.149 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:41 smithi043 ceph-mon[29167]: pgmap v369: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-04-25T20:48:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:41 smithi195 ceph-mon[33250]: pgmap v369: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-04-25T20:48:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:41 smithi112 ceph-mon[32322]: pgmap v369: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 -- 172.21.15.43:0/1892814534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04103480 msgr2=0x7f6c0410f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 --2- 172.21.15.43:0/1892814534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04103480 0x7f6c0410f8d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b0a0 tx=0x7f6bfc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 -- 172.21.15.43:0/1892814534 shutdown_connections 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 --2- 172.21.15.43:0/1892814534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04108a70 0x7f6c04108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 --2- 172.21.15.43:0/1892814534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04103480 0x7f6c0410f8d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 --2- 172.21.15.43:0/1892814534 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04102ac0 0x7f6c04102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 -- 172.21.15.43:0/1892814534 >> 172.21.15.43:0/1892814534 conn(0x7f6c04079bb0 msgr2=0x7f6c04079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:43.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 -- 172.21.15.43:0/1892814534 shutdown_connections 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.545+0000 7f6c0976e700 1 -- 172.21.15.43:0/1892814534 wait complete. 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.546+0000 7f6c0976e700 1 Processor -- start 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.546+0000 7f6c0976e700 1 -- start start 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04103480 0x7f6c041998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04108a70 0x7f6c0419dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04112e40 con 0x7f6c04102ac0 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04112cc0 con 0x7f6c04108a70 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c0976e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04112fc0 con 0x7f6c04103480 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33184/0 (socket says 172.21.15.43:33184) 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 -- 172.21.15.43:0/2622665717 learned_addr learned my addr 172.21.15.43:0/2622665717 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c037fe700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04108a70 0x7f6c0419dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6bfa7fc700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04103480 0x7f6c041998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:43.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 -- 172.21.15.43:0/2622665717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04103480 msgr2=0x7f6c041998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04103480 0x7f6c041998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 -- 172.21.15.43:0/2622665717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04108a70 msgr2=0x7f6c0419dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04108a70 0x7f6c0419dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 -- 172.21.15.43:0/2622665717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0419e380 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.547+0000 7f6c02ffd700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b530 tx=0x7f6bf400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.548+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4015020 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.548+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0419e670 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.548+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6bf4011d00 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.548+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4010e40 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.548+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041a5ef0 con 0x7f6c04102ac0 2024-04-25T20:48:43.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.549+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c04069730 con 0x7f6c04102ac0 2024-04-25T20:48:43.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.550+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f6bf4018020 con 0x7f6c04102ac0 2024-04-25T20:48:43.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.551+0000 7f6c00ff9700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 0x7f6bf00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:43.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.551+0000 7f6bfa7fc700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 0x7f6bf00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:43.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.551+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f6bf40cfff0 con 0x7f6c04102ac0 2024-04-25T20:48:43.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.551+0000 7f6bfa7fc700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 0x7f6bf00a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c0407a2d0 tx=0x7f6bec009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:43.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.555+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6bf401f020 con 0x7f6c04102ac0 2024-04-25T20:48:43.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.810+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c0419a6d0 con 0x7f6c04102ac0 2024-04-25T20:48:43.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.811+0000 7f6c00ff9700 1 -- 172.21.15.43:0/2622665717 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7f6bf409c9e0 con 0x7f6c04102ac0 2024-04-25T20:48:43.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:43.812 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 msgr2=0x7f6bf00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 0x7f6bf00a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c0407a2d0 tx=0x7f6bec009190 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 msgr2=0x7f6c04199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b530 tx=0x7f6bf400b840 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 shutdown_connections 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6bf00a3c40 0x7f6bf00a6100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c04108a70 0x7f6c0419dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c04102ac0 0x7f6c04199370 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 --2- 172.21.15.43:0/2622665717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c04103480 0x7f6c041998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 >> 172.21.15.43:0/2622665717 conn(0x7f6c04079bb0 msgr2=0x7f6c041018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:43.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 shutdown_connections 2024-04-25T20:48:43.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:43.813+0000 7f6c0976e700 1 -- 172.21.15.43:0/2622665717 wait complete. 2024-04-25T20:48:43.815 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:48:44.187 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:43 smithi043 ceph-mon[29167]: pgmap v370: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-25T20:48:44.188 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:43 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2622665717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:43 smithi195 ceph-mon[33250]: pgmap v370: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-25T20:48:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:43 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2622665717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:43 smithi112 ceph-mon[32322]: pgmap v370: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-04-25T20:48:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:43 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2622665717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:44.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:48:44.800 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:45.972 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:45 smithi043 ceph-mon[29167]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:46.144 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:45 smithi195 ceph-mon[33250]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:45 smithi112 ceph-mon[32322]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 10 op/s 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 -- 172.21.15.43:0/233102121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c108a50 msgr2=0x7f6f9c108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/233102121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c108a50 0x7f6f9c108e30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009990 tx=0x7f6f90009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 -- 172.21.15.43:0/233102121 shutdown_connections 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/233102121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c103450 0x7f6f9c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/233102121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c108a50 0x7f6f9c108e30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/233102121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 -- 172.21.15.43:0/233102121 >> 172.21.15.43:0/233102121 conn(0x7f6f9c079ba0 msgr2=0x7f6f9c079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 -- 172.21.15.43:0/233102121 shutdown_connections 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.539+0000 7f6fa2e09700 1 -- 172.21.15.43:0/233102121 wait complete. 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 Processor -- start 2024-04-25T20:48:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 -- start start 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 0x7f6f9c0757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c112d60 con 0x7f6f9c103450 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c112be0 con 0x7f6f9c102a90 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa2e09700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c112ee0 con 0x7f6f9c108a50 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa0ba5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6f9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37340/0 (socket says 172.21.15.43:37340) 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6f9bfff700 1 -- 172.21.15.43:0/3193190716 learned_addr learned my addr 172.21.15.43:0/3193190716 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.540+0000 7f6fa13a6700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 0x7f6f9c0757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 -- 172.21.15.43:0/3193190716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 msgr2=0x7f6f9c0757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 0x7f6f9c0757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 -- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 msgr2=0x7f6f9c075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 -- 172.21.15.43:0/3193190716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c1a7740 con 0x7f6f9c102a90 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa13a6700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 0x7f6f9c0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6f9bfff700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa0ba5700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c074d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f900059d0 tx=0x7f6f900047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90027070 con 0x7f6f9c102a90 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c1a79d0 con 0x7f6f9c102a90 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f9000b610 con 0x7f6f9c102a90 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f900173f0 con 0x7f6f9c102a90 2024-04-25T20:48:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.541+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c1a7e80 con 0x7f6f9c102a90 2024-04-25T20:48:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.542+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c069730 con 0x7f6f9c102a90 2024-04-25T20:48:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.544+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f6f9002a070 con 0x7f6f9c102a90 2024-04-25T20:48:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.544+0000 7f6f99ffb700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 0x7f6f8c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.544+0000 7f6f9bfff700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 0x7f6f8c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:46.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.544+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f6f900d1970 con 0x7f6f9c102a90 2024-04-25T20:48:46.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.545+0000 7f6f9bfff700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 0x7f6f8c0a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c07a280 tx=0x7f6f88007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:46.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.548+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6f90031070 con 0x7f6f9c102a90 2024-04-25T20:48:46.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.760+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f9c02df80 con 0x7f6f9c102a90 2024-04-25T20:48:46.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.762+0000 7f6f99ffb700 1 -- 172.21.15.43:0/3193190716 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22627 (secure 0 0 0) 0x7f6f900bce20 con 0x7f6f9c102a90 2024-04-25T20:48:46.763 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:46.763 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":91,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:47:05.741996+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 msgr2=0x7f6f8c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 0x7f6f8c0a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c07a280 tx=0x7f6f88007480 comp rx=0 tx=0).stop 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 msgr2=0x7f6f9c074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c074d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f900059d0 tx=0x7f6f900047b0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 shutdown_connections 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f6f8c0a3c40 0x7f6f8c0a6100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f9c108a50 0x7f6f9c0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6f9c102a90 0x7f6f9c074d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 --2- 172.21.15.43:0/3193190716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f9c103450 0x7f6f9c075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:46.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 >> 172.21.15.43:0/3193190716 conn(0x7f6f9c079ba0 msgr2=0x7f6f9c101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:46.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 shutdown_connections 2024-04-25T20:48:46.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:46.764+0000 7f6fa2e09700 1 -- 172.21.15.43:0/3193190716 wait complete. 2024-04-25T20:48:47.131 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:46 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3193190716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:48:47.333 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:46 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3193190716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:48:47.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:46 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3193190716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:48:47.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:48:47.730 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:48.135 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:47 smithi043 ceph-mon[29167]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-04-25T20:48:48.244 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:47 smithi112 ceph-mon[32322]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-04-25T20:48:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:47 smithi195 ceph-mon[33250]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 -- 172.21.15.43:0/340710888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730103460 msgr2=0x7f873010f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 --2- 172.21.15.43:0/340710888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730103460 0x7f873010f940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f872800b0a0 tx=0x7f872800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 -- 172.21.15.43:0/340710888 shutdown_connections 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 --2- 172.21.15.43:0/340710888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730103460 0x7f873010f940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 --2- 172.21.15.43:0/340710888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 0x7f8730108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 --2- 172.21.15.43:0/340710888 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730102ac0 0x7f8730102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 -- 172.21.15.43:0/340710888 >> 172.21.15.43:0/340710888 conn(0x7f8730079bf0 msgr2=0x7f873007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:49.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 -- 172.21.15.43:0/340710888 shutdown_connections 2024-04-25T20:48:49.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.389+0000 7f8734e89700 1 -- 172.21.15.43:0/340710888 wait complete. 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 Processor -- start 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 -- start start 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 0x7f8730075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 0x7f87300757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112dd0 con 0x7f8730102ac0 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112c50 con 0x7f8730108a70 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f8734e89700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8730112f50 con 0x7f8730103460 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f872e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f872e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37362/0 (socket says 172.21.15.43:37362) 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f872e59c700 1 -- 172.21.15.43:0/3641203247 learned_addr learned my addr 172.21.15.43:0/3641203247 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.390+0000 7f872ed9d700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 0x7f87300757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f8727fff700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 0x7f8730075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 -- 172.21.15.43:0/3641203247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 msgr2=0x7f8730075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 0x7f8730075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 -- 172.21.15.43:0/3641203247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 msgr2=0x7f87300757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 0x7f87300757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 -- 172.21.15.43:0/3641203247 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87301a7660 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f8727fff700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 0x7f8730075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f872e59c700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f872000d980 tx=0x7f872000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720016070 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8720004d00 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87301a7950 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720005610 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.391+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301a7e90 con 0x7f8730102ac0 2024-04-25T20:48:49.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.392+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730069730 con 0x7f8730102ac0 2024-04-25T20:48:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.393+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8720004750 con 0x7f8730102ac0 2024-04-25T20:48:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.394+0000 7f87277fe700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 0x7f871c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.394+0000 7f8727fff700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 0x7f871c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.394+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f87200d0150 con 0x7f8730102ac0 2024-04-25T20:48:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.394+0000 7f8727fff700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 0x7f871c0a6180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8718005fd0 tx=0x7f8718005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:49.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.399+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f872001f020 con 0x7f8730102ac0 2024-04-25T20:48:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.657+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f873002e140 con 0x7f8730102ac0 2024-04-25T20:48:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.658+0000 7f87277fe700 1 -- 172.21.15.43:0/3641203247 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7f872009cae0 con 0x7f8730102ac0 2024-04-25T20:48:49.660 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:48:49.660 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 msgr2=0x7f871c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 0x7f871c0a6180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8718005fd0 tx=0x7f8718005e30 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 msgr2=0x7f8730074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f872000d980 tx=0x7f872000dc90 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 shutdown_connections 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f871c0a3cc0 0x7f871c0a6180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8730108a70 0x7f87300757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8730102ac0 0x7f8730074d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 --2- 172.21.15.43:0/3641203247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8730103460 0x7f8730075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 >> 172.21.15.43:0/3641203247 conn(0x7f8730079bf0 msgr2=0x7f8730100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 shutdown_connections 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:49.660+0000 7f8734e89700 1 -- 172.21.15.43:0/3641203247 wait complete. 2024-04-25T20:48:49.662 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:48:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:49 smithi043 ceph-mon[29167]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:48:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:49 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3641203247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:49 smithi195 ceph-mon[33250]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:48:50.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:49 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3641203247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:50.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:49 smithi112 ceph-mon[32322]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-04-25T20:48:50.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:49 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3641203247' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:48:50.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T20:46:27.488319+0000', 'modified': '2024-04-25T20:46:49.738625+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24470, 'mds_1': 24449, 'mds_2': 24448, 'mds_3': 24430, 'mds_4': 24424}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14556': {'gid': 14556, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/283016818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 283016818}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 283016818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14568': {'gid': 14568, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6841/2354201113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 2354201113}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 2354201113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/2602577561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2602577561}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2602577561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6833/2634876322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 2634876322}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 2634876322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/1792854312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1792854312}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1792854312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.195:6835/1478210024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1478210024}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1478210024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.195:6837/97560283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 97560283}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 97560283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.195:6839/4260595708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 4260595708}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 4260595708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.112:6837/246583870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 246583870}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 246583870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.112:6839/2400080298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 2400080298}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 2400080298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24470, 'qdb_cluster': [24424, 24430, 24448, 24449, 24470]} 2024-04-25T20:48:50.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T20:48:50.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-25T20:48:50.639 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:52.112 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:51 smithi043 ceph-mon[29167]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T20:48:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:51 smithi195 ceph-mon[33250]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T20:48:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:51 smithi112 ceph-mon[32322]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-25T20:48:52.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 -- 172.21.15.43:0/3622915278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 msgr2=0x7f06ec10f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 --2- 172.21.15.43:0/3622915278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec10f900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009990 tx=0x7f06e4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 -- 172.21.15.43:0/3622915278 shutdown_connections 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 --2- 172.21.15.43:0/3622915278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec108a30 0x7f06ec108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 --2- 172.21.15.43:0/3622915278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec10f900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.354+0000 7f06f3a91700 1 --2- 172.21.15.43:0/3622915278 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec06a750 0x7f06ec06abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.355+0000 7f06f3a91700 1 -- 172.21.15.43:0/3622915278 >> 172.21.15.43:0/3622915278 conn(0x7f06ec0788f0 msgr2=0x7f06ec078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.355+0000 7f06f3a91700 1 -- 172.21.15.43:0/3622915278 shutdown_connections 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.355+0000 7f06f3a91700 1 -- 172.21.15.43:0/3622915278 wait complete. 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.355+0000 7f06f3a91700 1 Processor -- start 2024-04-25T20:48:52.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.355+0000 7f06f3a91700 1 -- start start 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 0x7f06ec199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec108a30 0x7f06ec19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112d90 con 0x7f06ec06b0f0 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112c10 con 0x7f06ec108a30 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112f10 con 0x7f06ec06a750 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37384/0 (socket says 172.21.15.43:37384) 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 -- 172.21.15.43:0/1828012197 learned_addr learned my addr 172.21.15.43:0/1828012197 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f182d700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 0x7f06ec199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 -- 172.21.15.43:0/1828012197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 msgr2=0x7f06ec199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f202e700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec108a30 0x7f06ec19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 0x7f06ec199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 -- 172.21.15.43:0/1828012197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec108a30 msgr2=0x7f06ec19da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec108a30 0x7f06ec19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 -- 172.21.15.43:0/1828012197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec19e1c0 con 0x7f06ec06b0f0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f182d700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 0x7f06ec199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f102c700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06e000d980 tx=0x7f06e000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06eaffd700 1 -- 172.21.15.43:0/1828012197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0016070 con 0x7f06ec06b0f0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06eaffd700 1 -- 172.21.15.43:0/1828012197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06e00044f0 con 0x7f06ec06b0f0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec19e4b0 con 0x7f06ec06b0f0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06eaffd700 1 -- 172.21.15.43:0/1828012197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0004d00 con 0x7f06ec06b0f0 2024-04-25T20:48:52.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.356+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1a5d30 con 0x7f06ec06b0f0 2024-04-25T20:48:52.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.358+0000 7f06eaffd700 1 -- 172.21.15.43:0/1828012197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f06e000bbf0 con 0x7f06ec06b0f0 2024-04-25T20:48:52.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.359+0000 7f06eaffd700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 0x7f06d40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.360+0000 7f06f182d700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 0x7f06d40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.360+0000 7f06eaffd700 1 -- 172.21.15.43:0/1828012197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f06e00d0330 con 0x7f06ec06b0f0 2024-04-25T20:48:52.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.360+0000 7f06f182d700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 0x7f06d40a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009d50 tx=0x7f06dc009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.360+0000 7f06fe31ab80 1 Processor -- start 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 -- start start 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570bb01bce0 con 0x5570bb0ce500 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570bafc2910 con 0x5570bb0cdbe0 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5570bb017ca0 con 0x5570bb0d2990 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37394/0 (socket says 172.21.15.43:37394) 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 -- 172.21.15.43:0/715408815 learned_addr learned my addr 172.21.15.43:0/715408815 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f182d700 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f202e700 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 -- 172.21.15.43:0/715408815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 msgr2=0x5570bb0d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 -- 172.21.15.43:0/715408815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 msgr2=0x5570bb0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 -- 172.21.15.43:0/715408815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570baf69880 con 0x5570bb0ce500 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.361+0000 7f06f102c700 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f06e00a4d00 tx=0x7f06e009c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f61d5fd22eb529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06d3fff700 1 -- 172.21.15.43:0/715408815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e009ccc0 con 0x5570bb0ce500 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06d3fff700 1 -- 172.21.15.43:0/715408815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06e009c5c0 con 0x5570bb0ce500 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06d3fff700 1 -- 172.21.15.43:0/715408815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0085b50 con 0x5570bb0ce500 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 -- 172.21.15.43:0/715408815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 msgr2=0x5570bb0d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f06e00a4d00 tx=0x7f06e009c180 comp rx=0 tx=0).stop 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 -- 172.21.15.43:0/715408815 shutdown_connections 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.362+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/715408815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0ce500 0x5570bb0d2450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.363+0000 7f06fe31ab80 1 -- 172.21.15.43:0/715408815 >> 172.21.15.43:0/715408815 conn(0x5570baff6640 msgr2=0x5570bb0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.363+0000 7f06fe31ab80 1 -- 172.21.15.43:0/715408815 shutdown_connections 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.363+0000 7f06fe31ab80 1 -- 172.21.15.43:0/715408815 wait complete. 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.363+0000 7f06fe31ab80 1 -- start start 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.363+0000 7f06fe31ab80 1 Processor -- start 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0da9c0 con 0x5570bb0d2990 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570bafbab80 con 0x5570bb0cdbe0 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0dab40 con 0x5570bb0ce500 2024-04-25T20:48:52.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06fe31ab80 10 client.0 _ll_register_callbacks cb 0x5570bafb4900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37410/0 (socket says 172.21.15.43:37410) 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 -- 172.21.15.43:0/1980686833 learned_addr learned my addr 172.21.15.43:0/1980686833 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f102c700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f182d700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 -- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 msgr2=0x5570bb0d7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0d7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 -- 172.21.15.43:0/1980686833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 msgr2=0x5570bb0d9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 -- 172.21.15.43:0/1980686833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bafd3220 con 0x5570bb0d2990 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06f202e700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005c40 tx=0x7f06e4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca35128d9bfdd11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.364+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4028060 con 0x5570bb0d2990 2024-04-25T20:48:52.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f06e40050c0 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e009c5c0 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f06e40052c0 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 10 client.14922 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5570bb0e5230 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06e009c5c0 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f06e400f700 con 0x5570bb0d2990 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 10 client.14922 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 10 client.14922 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 20 client.14922 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb0e7840 0x5570bb0e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 4 client.14922 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:48:52.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.365+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570bb0294d0 con 0x5570bb0e7840 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.366+0000 7f06f182d700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb0e7840 0x5570bb0e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.366+0000 7f06d17fa700 10 client.14922 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.366+0000 7f06f182d700 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb0e7840 0x5570bb0e8cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c8cad3df550fb9e9 server_cookie=e7b7f6431e353830 in_seq=0 out_seq=0 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06d17fa700 1 -- 172.21.15.43:0/1980686833 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5570bb0294d0 con 0x5570bb0e7840 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06d17fa700 10 client.14922 handle_command_reply: tid=0 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 client.14922 shutdown 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 msgr2=0x5570bb0d76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005c40 tx=0x7f06e4005c70 comp rx=0 tx=0).stop 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 shutdown_connections 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb0e7840 0x5570bb0e8cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0d76b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/1980686833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 >> 172.21.15.43:0/1980686833 conn(0x5570baff6640 msgr2=0x5570bb0d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06d17fa700 0 client.14922 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:48:52.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 shutdown_connections 2024-04-25T20:48:52.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.367+0000 7f06fe31ab80 1 -- 172.21.15.43:0/1980686833 wait complete. 2024-04-25T20:48:52.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.368+0000 7f06fe31ab80 20 client.14922 trim_cache size 0 max 16384 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 Processor -- start 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 -- start start 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e6ff0 con 0x5570bb0d2990 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e76c0 con 0x5570bb0cdbe0 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.388+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e7d90 con 0x5570bb0ce500 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37422/0 (socket says 172.21.15.43:37422) 2024-04-25T20:48:52.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 -- 172.21.15.43:0/606331581 learned_addr learned my addr 172.21.15.43:0/606331581 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 -- 172.21.15.43:0/606331581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 msgr2=0x5570bb0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f102c700 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 -- 172.21.15.43:0/606331581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 msgr2=0x5570bb0d7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f182d700 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 -- 172.21.15.43:0/606331581 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bb0d5720 con 0x5570bb0d2990 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06f202e700 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009990 tx=0x7f06e400b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2099d94426e02c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06d37fe700 1 -- 172.21.15.43:0/606331581 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4033070 con 0x5570bb0d2990 2024-04-25T20:48:52.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06d37fe700 1 -- 172.21.15.43:0/606331581 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06e40058e0 con 0x5570bb0d2990 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.389+0000 7f06d37fe700 1 -- 172.21.15.43:0/606331581 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4028040 con 0x5570bb0d2990 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- 172.21.15.43:0/606331581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 msgr2=0x5570bb0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009990 tx=0x7f06e400b640 comp rx=0 tx=0).stop 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- 172.21.15.43:0/606331581 shutdown_connections 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0d2990 0x5570bb0c8b20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0cdbe0 0x5570bb0d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/606331581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0ce500 0x5570bb0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- 172.21.15.43:0/606331581 >> 172.21.15.43:0/606331581 conn(0x5570baff6640 msgr2=0x5570bb0d5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- 172.21.15.43:0/606331581 shutdown_connections 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- 172.21.15.43:0/606331581 wait complete. 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 -- start start 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.390+0000 7f06fe31ab80 1 Processor -- start 2024-04-25T20:48:52.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 0x5570bb0efa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e8b30 con 0x5570bb0cdbe0 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e8460 con 0x5570bb0ce500 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5570bb0e9200 con 0x5570bb0d2990 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06fe31ab80 10 client.0 _ll_register_callbacks cb 0x5570bafb4900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37436/0 (socket says 172.21.15.43:37436) 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 -- 172.21.15.43:0/2233499780 learned_addr learned my addr 172.21.15.43:0/2233499780 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f102c700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 0x5570bb0efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f202e700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 -- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 msgr2=0x5570bb0effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 -- 172.21.15.43:0/2233499780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 msgr2=0x5570bb0efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 0x5570bb0efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 -- 172.21.15.43:0/2233499780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bb0d4030 con 0x5570bb0cdbe0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f102c700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 0x5570bb0efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f202e700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06f182d700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009320 tx=0x7f06dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f4d11b7fc8dffe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.391+0000 7f06d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004bb0 con 0x5570bb0cdbe0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f06dc004d50 con 0x5570bb0cdbe0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e40058e0 con 0x5570bb0cdbe0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f06dc02bb50 con 0x5570bb0cdbe0 2024-04-25T20:48:52.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 10 client.14928 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5570bb14ee00 con 0x5570bb0cdbe0 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06e40058e0 con 0x5570bb0cdbe0 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f06dc005290 con 0x5570bb0cdbe0 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 10 client.14928 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 10 client.14928 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 20 client.14928 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb153a80 0x5570bb152790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 4 client.14928 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "status"}) -- 0x5570bb023570 con 0x5570bb153a80 2024-04-25T20:48:52.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.392+0000 7f06f102c700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb153a80 0x5570bb152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:52.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06f102c700 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb153a80 0x5570bb152790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7270dc0b553b3b75 server_cookie=71527412f33d02fa in_seq=0 out_seq=0 2024-04-25T20:48:52.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06d17fa700 10 client.14928 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:48:52.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06d17fa700 1 -- 172.21.15.43:0/2233499780 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5570bb023570 con 0x5570bb153a80 2024-04-25T20:48:52.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06d17fa700 10 client.14928 handle_command_reply: tid=0 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 client.14928 shutdown 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 msgr2=0x5570bb0ef530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009320 tx=0x7f06dc012000 comp rx=0 tx=0).stop 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 shutdown_connections 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x5570bb153a80 0x5570bb152790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5570bb0d2990 0x5570bb0effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570bb0cdbe0 0x5570bb0ef530 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 --2- 172.21.15.43:0/2233499780 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5570bb0ce500 0x5570bb0efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06d17fa700 0 client.14928 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 >> 172.21.15.43:0/2233499780 conn(0x5570baff6640 msgr2=0x5570bb0d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 shutdown_connections 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.393+0000 7f06fe31ab80 1 -- 172.21.15.43:0/2233499780 wait complete. 2024-04-25T20:48:52.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06fe31ab80 20 client.14928 trim_cache size 0 max 16384 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 4, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24424, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 126.90032626, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 179.67219746699999 2024-04-25T20:48:52.400 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:48:52.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 msgr2=0x7f06d40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 0x7f06d40a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009d50 tx=0x7f06dc009040 comp rx=0 tx=0).stop 2024-04-25T20:48:52.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 msgr2=0x7f06ec199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:52.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f06e000d980 tx=0x7f06e000dd40 comp rx=0 tx=0).stop 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 shutdown_connections 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f06d40a3c40 0x7f06d40a6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06ec06a750 0x7f06ec199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06ec108a30 0x7f06ec19da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 --2- 172.21.15.43:0/1828012197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06ec06b0f0 0x7f06ec199740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 >> 172.21.15.43:0/1828012197 conn(0x7f06ec0788f0 msgr2=0x7f06ec0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 shutdown_connections 2024-04-25T20:48:52.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:52.394+0000 7f06f3a91700 1 -- 172.21.15.43:0/1828012197 wait complete. 2024-04-25T20:48:53.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-25T20:48:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:53 smithi043 ceph-mon[29167]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:53 smithi195 ceph-mon[33250]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:53 smithi112 ceph-mon[32322]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- 172.21.15.43:0/1575169800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406bbb0 msgr2=0x7f450410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 --2- 172.21.15.43:0/1575169800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406bbb0 0x7f450410f930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00b0a0 tx=0x7f44fc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- 172.21.15.43:0/1575169800 shutdown_connections 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 --2- 172.21.15.43:0/1575169800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406bbb0 0x7f450410f930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 --2- 172.21.15.43:0/1575169800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f4504108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 --2- 172.21.15.43:0/1575169800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406b1f0 0x7f450406b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- 172.21.15.43:0/1575169800 >> 172.21.15.43:0/1575169800 conn(0x7f45040789e0 msgr2=0x7f4504078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- 172.21.15.43:0/1575169800 shutdown_connections 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- 172.21.15.43:0/1575169800 wait complete. 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 Processor -- start 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.146+0000 7f450a416700 1 -- start start 2024-04-25T20:48:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406bbb0 0x7f450419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f450419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112dc0 con 0x7f450406b1f0 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112c40 con 0x7f4504108a60 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f450a416700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112f40 con 0x7f450406bbb0 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37458/0 (socket says 172.21.15.43:37458) 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 -- 172.21.15.43:0/993983081 learned_addr learned my addr 172.21.15.43:0/993983081 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f45089b3700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f450419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f45037fe700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406bbb0 0x7f450419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 -- 172.21.15.43:0/993983081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406bbb0 msgr2=0x7f450419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406bbb0 0x7f450419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 -- 172.21.15.43:0/993983081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 msgr2=0x7f450419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f450419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 -- 172.21.15.43:0/993983081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45041a0320 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f45089b3700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f450419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f4503fff700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c920 tx=0x7f44f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.147+0000 7f45017fa700 1 -- 172.21.15.43:0/993983081 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007b00 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.148+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45041a0610 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.148+0000 7f45017fa700 1 -- 172.21.15.43:0/993983081 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f4004d00 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.148+0000 7f45017fa700 1 -- 172.21.15.43:0/993983081 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4005620 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.148+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041a7e90 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.150+0000 7f45017fa700 1 -- 172.21.15.43:0/993983081 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f44f4004750 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.150+0000 7f45017fa700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 0x7f44ec0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.150+0000 7f45037fe700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 0x7f44ec0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.150+0000 7f45017fa700 1 -- 172.21.15.43:0/993983081 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f44f40cffd0 con 0x7f450406b1f0 2024-04-25T20:48:55.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.151+0000 7f45037fe700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 0x7f44ec0a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005fd0 tx=0x7f44f800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.151+0000 7f4514c9fb80 1 Processor -- start 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.151+0000 7f4514c9fb80 1 -- start start 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.151+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b3098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b309d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1b2feace0 con 0x55a1b30990f0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a1b2f91910 con 0x55a1b309d580 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a1b2fe6ca0 con 0x55a1b30987d0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37466/0 (socket says 172.21.15.43:37466) 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 -- 172.21.15.43:0/3212001040 learned_addr learned my addr 172.21.15.43:0/3212001040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45089b3700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b309d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4503fff700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b3098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 -- 172.21.15.43:0/3212001040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 msgr2=0x55a1b3098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b3098bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 -- 172.21.15.43:0/3212001040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 msgr2=0x55a1b309d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b309d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 -- 172.21.15.43:0/3212001040 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1b2f38880 con 0x55a1b30990f0 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f4503fff700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b3098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f45037fe700 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ec40 tx=0x7f44f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0766404d794ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f44ea7fc700 1 -- 172.21.15.43:0/3212001040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8021070 con 0x55a1b30990f0 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f44ea7fc700 1 -- 172.21.15.43:0/3212001040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f8010d90 con 0x55a1b30990f0 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.152+0000 7f44ea7fc700 1 -- 172.21.15.43:0/3212001040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f800f750 con 0x55a1b30990f0 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3212001040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 msgr2=0x55a1b309d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ec40 tx=0x7f44f8011000 comp rx=0 tx=0).stop 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3212001040 shutdown_connections 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b3098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b309d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3212001040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309d040 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3212001040 >> 172.21.15.43:0/3212001040 conn(0x55a1b2fc5640 msgr2=0x55a1b3093820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3212001040 shutdown_connections 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3212001040 wait complete. 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.153+0000 7f4514c9fb80 1 -- start start 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 Processor -- start 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 0x55a1b30a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30990f0 0x55a1b30a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30a5610 con 0x55a1b309d580 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a1b2f89b80 con 0x55a1b30987d0 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30a5790 con 0x55a1b30990f0 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4514c9fb80 10 client.0 _ll_register_callbacks cb 0x55a1b2f83900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37482/0 (socket says 172.21.15.43:37482) 2024-04-25T20:48:55.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 -- 172.21.15.43:0/3628902753 learned_addr learned my addr 172.21.15.43:0/3628902753 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45037fe700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30990f0 0x55a1b30a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4503fff700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 0x55a1b30a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 -- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30990f0 msgr2=0x55a1b30a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30990f0 0x55a1b30a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 -- 172.21.15.43:0/3628902753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 msgr2=0x55a1b30a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 0x55a1b30a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 -- 172.21.15.43:0/3628902753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1b2fa2220 con 0x55a1b309d580 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f4503fff700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 0x55a1b30a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f45089b3700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44fc004a50 tx=0x7f44fc004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85c92f169f77cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.154+0000 7f44e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0076f0 con 0x55a1b309d580 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f44fc007890 con 0x55a1b309d580 2024-04-25T20:48:55.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f8010d90 con 0x55a1b309d580 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f44fc007a90 con 0x55a1b309d580 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 10 client.14940 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a1b30afe10 con 0x55a1b309d580 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f8010d90 con 0x55a1b309d580 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f44fc011070 con 0x55a1b309d580 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 10 client.14940 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 10 client.14940 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 20 client.14940 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b30b24a0 0x55a1b30b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 4 client.14940 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.155+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1b2ff84d0 con 0x55a1b30b24a0 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.156+0000 7f4503fff700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b30b24a0 0x55a1b30b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.156+0000 7f4503fff700 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b30b24a0 0x55a1b30b3910 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=22ffb55f77baf34e server_cookie=2ebb65af6738bf4 in_seq=0 out_seq=0 2024-04-25T20:48:55.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.156+0000 7f44e37fe700 10 client.14940 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f44e37fe700 1 -- 172.21.15.43:0/3628902753 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a1b2ff84d0 con 0x55a1b30b24a0 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f44e37fe700 10 client.14940 handle_command_reply: tid=0 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 client.14940 shutdown 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 msgr2=0x55a1b30a2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44fc004a50 tx=0x7f44fc004b30 comp rx=0 tx=0).stop 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 shutdown_connections 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b30b24a0 0x55a1b30b3910 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a2280 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f44e37fe700 0 client.14940 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30987d0 0x55a1b30a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3628902753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30990f0 0x55a1b30a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 >> 172.21.15.43:0/3628902753 conn(0x55a1b2fc5640 msgr2=0x55a1b309e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 shutdown_connections 2024-04-25T20:48:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.157+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3628902753 wait complete. 2024-04-25T20:48:55.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.158+0000 7f4514c9fb80 20 client.14940 trim_cache size 0 max 16384 2024-04-25T20:48:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 Processor -- start 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 -- start start 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b30a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30990f0 0x55a1b30a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.178+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b1c50 con 0x55a1b309d580 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b2320 con 0x55a1b30990f0 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b29f0 con 0x55a1b30987d0 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37494/0 (socket says 172.21.15.43:37494) 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 -- 172.21.15.43:0/3352067893 learned_addr learned my addr 172.21.15.43:0/3352067893 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f4503fff700 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b30a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45037fe700 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30990f0 0x55a1b30a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 -- 172.21.15.43:0/3352067893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 msgr2=0x55a1b30a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b30a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 -- 172.21.15.43:0/3352067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30990f0 msgr2=0x55a1b30a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30990f0 0x55a1b30a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 -- 172.21.15.43:0/3352067893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1b30a5740 con 0x55a1b309d580 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f45089b3700 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005b80 tx=0x7f44fc006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49f8fdb5cbfae6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f44e9ffb700 1 -- 172.21.15.43:0/3352067893 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0078b0 con 0x55a1b309d580 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f44e9ffb700 1 -- 172.21.15.43:0/3352067893 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44fc035020 con 0x55a1b309d580 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.179+0000 7f44e9ffb700 1 -- 172.21.15.43:0/3352067893 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc005dc0 con 0x55a1b309d580 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3352067893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 msgr2=0x55a1b30a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44fc005b80 tx=0x7f44fc006210 comp rx=0 tx=0).stop 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3352067893 shutdown_connections 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b30a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b309d580 0x55a1b30a4580 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3352067893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b30990f0 0x55a1b30a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3352067893 >> 172.21.15.43:0/3352067893 conn(0x55a1b2fc5640 msgr2=0x55a1b3097e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3352067893 shutdown_connections 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3352067893 wait complete. 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.180+0000 7f4514c9fb80 1 -- start start 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 Processor -- start 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b309ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b30b9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b3790 con 0x55a1b30990f0 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b30c0 con 0x55a1b309d580 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a1b30b3e60 con 0x55a1b30987d0 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4514c9fb80 10 client.0 _ll_register_callbacks cb 0x55a1b2f83900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37496/0 (socket says 172.21.15.43:37496) 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 -- 172.21.15.43:0/3814487660 learned_addr learned my addr 172.21.15.43:0/3814487660 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f4503fff700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b309ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45089b3700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b30b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 -- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 msgr2=0x55a1b309ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b309ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 -- 172.21.15.43:0/3814487660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 msgr2=0x55a1b30b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b30b9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 -- 172.21.15.43:0/3814487660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1b30b97d0 con 0x55a1b30990f0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f45037fe700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44f800aa60 tx=0x7f44f80052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c1cfae574d608 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.181+0000 7f44e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8021050 con 0x55a1b30990f0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f44f80046f0 con 0x55a1b30990f0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44fc035020 con 0x55a1b30990f0 2024-04-25T20:48:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f44f80048f0 con 0x55a1b30990f0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 10 client.14946 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a1b3119c70 con 0x55a1b30990f0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44fc035020 con 0x55a1b30990f0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f44f801db00 con 0x55a1b30990f0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 10 client.14946 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 10 client.14946 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 20 client.14946 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b311e490 0x55a1b311d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 4 client.14946 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.182+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "status"}) -- 0x55a1b2ff2570 con 0x55a1b311e490 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4503fff700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b311e490 0x55a1b311d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4503fff700 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b311e490 0x55a1b311d1a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f92b484a2c84d6c2 server_cookie=45f087424cbf2d6a in_seq=0 out_seq=0 2024-04-25T20:48:55.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f44e37fe700 10 client.14946 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f44e37fe700 1 -- 172.21.15.43:0/3814487660 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55a1b2ff2570 con 0x55a1b311e490 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f44e37fe700 10 client.14946 handle_command_reply: tid=0 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 client.14946 shutdown 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 msgr2=0x55a1b309f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44f800aa60 tx=0x7f44f80052c0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 shutdown_connections 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55a1b311e490 0x55a1b311d1a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1b30987d0 0x55a1b309ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a1b309d580 0x55a1b30b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f44e37fe700 0 client.14946 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 --2- 172.21.15.43:0/3814487660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a1b30990f0 0x55a1b309f4c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.183+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 >> 172.21.15.43:0/3814487660 conn(0x55a1b2fc5640 msgr2=0x55a1b309c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 shutdown_connections 2024-04-25T20:48:55.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f4514c9fb80 1 -- 172.21.15.43:0/3814487660 wait complete. 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f4514c9fb80 20 client.14946 trim_cache size 0 max 16384 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 3, 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24430, 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 130.704989627, 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:48:55.192 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 179.65667306 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 msgr2=0x7f44ec0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 0x7f44ec0a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005fd0 tx=0x7f44f800a560 comp rx=0 tx=0).stop 2024-04-25T20:48:55.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 msgr2=0x7f450419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c920 tx=0x7f44f400cce0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 shutdown_connections 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f44ec0a3c40 0x7f44ec0a6100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4504108a60 0x7f450419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f450406b1f0 0x7f450419b360 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 --2- 172.21.15.43:0/993983081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f450406bbb0 0x7f450419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.184+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 >> 172.21.15.43:0/993983081 conn(0x7f45040789e0 msgr2=0x7f450410dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.185+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 shutdown_connections 2024-04-25T20:48:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:55.185+0000 7f450a416700 1 -- 172.21.15.43:0/993983081 wait complete. 2024-04-25T20:48:55.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-25T20:48:56.253 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:48:56.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:55 smithi043 ceph-mon[29167]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:55 smithi195 ceph-mon[33250]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:55 smithi112 ceph-mon[32322]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 -- 172.21.15.43:0/2226837306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424108a50 msgr2=0x7fe424108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 --2- 172.21.15.43:0/2226837306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424108a50 0x7fe424108e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe420009990 tx=0x7fe420009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 -- 172.21.15.43:0/2226837306 shutdown_connections 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 --2- 172.21.15.43:0/2226837306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42410f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 --2- 172.21.15.43:0/2226837306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424108a50 0x7fe424108e30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 --2- 172.21.15.43:0/2226837306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424102a90 0x7fe424102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 -- 172.21.15.43:0/2226837306 >> 172.21.15.43:0/2226837306 conn(0x7fe424079ba0 msgr2=0x7fe424079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 -- 172.21.15.43:0/2226837306 shutdown_connections 2024-04-25T20:48:58.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.069+0000 7fe42b447700 1 -- 172.21.15.43:0/2226837306 wait complete. 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 Processor -- start 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 -- start start 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424108a50 0x7fe42419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe424112d40 con 0x7fe424102a90 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe424112bc0 con 0x7fe424103450 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe42b447700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe424112ec0 con 0x7fe424108a50 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35776/0 (socket says 172.21.15.43:35776) 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 -- 172.21.15.43:0/1068534799 learned_addr learned my addr 172.21.15.43:0/1068534799 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4289e2700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4299e4700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424108a50 0x7fe42419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 -- 172.21.15.43:0/1068534799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424108a50 msgr2=0x7fe42419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424108a50 0x7fe42419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 -- 172.21.15.43:0/1068534799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 msgr2=0x7fe42419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42419b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 -- 172.21.15.43:0/1068534799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4241a0410 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4289e2700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.070+0000 7fe4291e3700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe420000c00 tx=0x7fe420004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.071+0000 7fe41a7fc700 1 -- 172.21.15.43:0/1068534799 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420027070 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.071+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4241a06a0 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.071+0000 7fe41a7fc700 1 -- 172.21.15.43:0/1068534799 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe420003fb0 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.071+0000 7fe41a7fc700 1 -- 172.21.15.43:0/1068534799 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420022e60 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.071+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4241a7f80 con 0x7fe424102a90 2024-04-25T20:48:58.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.073+0000 7fe41a7fc700 1 -- 172.21.15.43:0/1068534799 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fe42002a070 con 0x7fe424102a90 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.074+0000 7fe41a7fc700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 0x7fe4100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.074+0000 7fe4289e2700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 0x7fe4100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.074+0000 7fe41a7fc700 1 -- 172.21.15.43:0/1068534799 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe4200d0fe0 con 0x7fe424102a90 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.074+0000 7fe4289e2700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 0x7fe4100a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe424076d60 tx=0x7fe414005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 Processor -- start 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 -- start start 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5580650f8ce0 con 0x5580651ab580 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55806509f910 con 0x5580651a67d0 2024-04-25T20:48:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5580650f4ca0 con 0x5580651a70f0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4299e4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4299e4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35786/0 (socket says 172.21.15.43:35786) 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4299e4700 1 -- 172.21.15.43:0/2334148345 learned_addr learned my addr 172.21.15.43:0/2334148345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4289e2700 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 -- 172.21.15.43:0/2334148345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 msgr2=0x5580651ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 -- 172.21.15.43:0/2334148345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 msgr2=0x5580651ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4291e3700 1 -- 172.21.15.43:0/2334148345 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558065046880 con 0x5580651a67d0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.075+0000 7fe4299e4700 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe4291e3700 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651a6bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4200cebe0 tx=0x7fe420009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e84dd5d6faf888b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe40f7fe700 1 -- 172.21.15.43:0/2334148345 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b6070 con 0x5580651a67d0 2024-04-25T20:48:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe40f7fe700 1 -- 172.21.15.43:0/2334148345 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4200a17b0 con 0x5580651a67d0 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe40f7fe700 1 -- 172.21.15.43:0/2334148345 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42009d8c0 con 0x5580651a67d0 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe435cd0b80 1 -- 172.21.15.43:0/2334148345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 msgr2=0x5580651a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.076+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651a6bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4200cebe0 tx=0x7fe420009ca0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 -- 172.21.15.43:0/2334148345 shutdown_connections 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651a6bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/2334148345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 -- 172.21.15.43:0/2334148345 >> 172.21.15.43:0/2334148345 conn(0x5580650d3640 msgr2=0x5580651a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 -- 172.21.15.43:0/2334148345 shutdown_connections 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 -- 172.21.15.43:0/2334148345 wait complete. 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 -- start start 2024-04-25T20:48:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 Processor -- start 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.077+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55806509f910 con 0x5580651ab580 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558065097b80 con 0x5580651a67d0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5580651b3460 con 0x5580651a70f0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe435cd0b80 10 client.0 _ll_register_callbacks cb 0x558065091900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35790/0 (socket says 172.21.15.43:35790) 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 -- 172.21.15.43:0/3738976572 learned_addr learned my addr 172.21.15.43:0/3738976572 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4289e2700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4291e3700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 -- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 msgr2=0x5580651afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 -- 172.21.15.43:0/3738976572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 msgr2=0x5580651b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 -- 172.21.15.43:0/3738976572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580650b0220 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe4299e4700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007af0 tx=0x7fe41c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282837642ff8db65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe40cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c01a030 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4200a17b0 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.078+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe41c012040 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe41c004bb0 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 10 client.14958 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580651bdc30 con 0x5580651ab580 2024-04-25T20:48:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4200a17b0 con 0x5580651ab580 2024-04-25T20:48:58.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe41c016b40 con 0x5580651ab580 2024-04-25T20:48:58.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 10 client.14958 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:58.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 10 client.14958 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:48:58.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 20 client.14958 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x5580651c02d0 0x5580651c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 4 client.14958 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:48:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580651064d0 con 0x5580651c02d0 2024-04-25T20:48:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.079+0000 7fe4291e3700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x5580651c02d0 0x5580651c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.080+0000 7fe40cff9700 10 client.14958 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.080+0000 7fe4291e3700 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x5580651c02d0 0x5580651c1740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccb5f8f7cb040083 server_cookie=8e8f18c5ef0cd902 in_seq=0 out_seq=0 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe40cff9700 1 -- 172.21.15.43:0/3738976572 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5580651064d0 con 0x5580651c02d0 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe40cff9700 10 client.14958 handle_command_reply: tid=0 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 client.14958 shutdown 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 msgr2=0x5580651b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007af0 tx=0x7fe41c007e00 comp rx=0 tx=0).stop 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 shutdown_connections 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x5580651c02d0 0x5580651c1740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651ab580 0x5580651b0320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/3738976572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 >> 172.21.15.43:0/3738976572 conn(0x5580650d3640 msgr2=0x5580651ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe40cff9700 0 client.14958 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 shutdown_connections 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 1 -- 172.21.15.43:0/3738976572 wait complete. 2024-04-25T20:48:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.081+0000 7fe435cd0b80 20 client.14958 trim_cache size 0 max 16384 2024-04-25T20:48:58.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 Processor -- start 2024-04-25T20:48:58.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 -- start start 2024-04-25T20:48:58.103 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:57 smithi043 ceph-mon[29167]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651ab580 0x5580651b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5580651bfa80 con 0x5580651a67d0 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5580651c0150 con 0x5580651ab580 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5580651c0820 con 0x5580651a70f0 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe4291e3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe4291e3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35806/0 (socket says 172.21.15.43:35806) 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe4291e3700 1 -- 172.21.15.43:0/164290230 learned_addr learned my addr 172.21.15.43:0/164290230 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.102+0000 7fe4299e4700 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651ab580 0x5580651b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4289e2700 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 -- 172.21.15.43:0/164290230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 msgr2=0x5580651ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 -- 172.21.15.43:0/164290230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651ab580 msgr2=0x5580651b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651ab580 0x5580651b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 -- 172.21.15.43:0/164290230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580651b3400 con 0x5580651a67d0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe4291e3700 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe420029000 tx=0x7fe420009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3953701447cf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe40effd700 1 -- 172.21.15.43:0/164290230 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b6040 con 0x5580651a67d0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe40effd700 1 -- 172.21.15.43:0/164290230 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe420004160 con 0x5580651a67d0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.103+0000 7fe40effd700 1 -- 172.21.15.43:0/164290230 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200a5db0 con 0x5580651a67d0 2024-04-25T20:48:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- 172.21.15.43:0/164290230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 msgr2=0x5580651b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe420029000 tx=0x7fe420009310 comp rx=0 tx=0).stop 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- 172.21.15.43:0/164290230 shutdown_connections 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651ab580 0x5580651b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a67d0 0x5580651b0410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/164290230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651a70f0 0x5580651ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- 172.21.15.43:0/164290230 >> 172.21.15.43:0/164290230 conn(0x5580650d3640 msgr2=0x5580651ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- 172.21.15.43:0/164290230 shutdown_connections 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- 172.21.15.43:0/164290230 wait complete. 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.104+0000 7fe435cd0b80 1 -- start start 2024-04-25T20:48:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 Processor -- start 2024-04-25T20:48:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 0x5580651c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5580651c15c0 con 0x5580651a70f0 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5580651c0ef0 con 0x5580651a67d0 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5580651c1c90 con 0x5580651ab580 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe435cd0b80 10 client.0 _ll_register_callbacks cb 0x558065091900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe4289e2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe4289e2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35810/0 (socket says 172.21.15.43:35810) 2024-04-25T20:48:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe4289e2700 1 -- 172.21.15.43:0/799289585 learned_addr learned my addr 172.21.15.43:0/799289585 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe4299e4700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 0x5580651c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.105+0000 7fe4291e3700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 -- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 msgr2=0x5580651c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 0x5580651c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 -- 172.21.15.43:0/799289585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 msgr2=0x5580651b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 -- 172.21.15.43:0/799289585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580651c77c0 con 0x5580651a70f0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4299e4700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 0x5580651c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4291e3700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe4289e2700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe41401f790 tx=0x7fe414004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289be05080d8b5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe40cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414004830 con 0x5580651a70f0 2024-04-25T20:48:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe4140049d0 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe420004160 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe414004bd0 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe435cd0b80 10 client.14964 fetch_fsmap learned FSMap version 27 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558065227c30 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.106+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe420004160 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe414010910 con 0x5580651a70f0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 10 client.14964 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 10 client.14964 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 20 client.14964 populate_metadata read hostname 'smithi043' 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55806522c8e0 0x55806522b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 4 client.14964 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "status"}) -- 0x558065100570 con 0x55806522c8e0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.107+0000 7fe4291e3700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55806522c8e0 0x55806522b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe40cff9700 10 client.14964 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:48:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe4291e3700 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55806522c8e0 0x55806522b5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e66f138ef32192d7 server_cookie=2fb5c87b5023da70 in_seq=0 out_seq=0 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe40cff9700 1 -- 172.21.15.43:0/799289585 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558065100570 con 0x55806522c8e0 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe40cff9700 10 client.14964 handle_command_reply: tid=0 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 client.14964 shutdown 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 msgr2=0x5580651b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe41401f790 tx=0x7fe414004750 comp rx=0 tx=0).stop 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 shutdown_connections 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55806522c8e0 0x55806522b5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5580651ab580 0x5580651c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5580651a67d0 0x5580651b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe40cff9700 0 client.14964 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 --2- 172.21.15.43:0/799289585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5580651a70f0 0x5580651b26d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 >> 172.21.15.43:0/799289585 conn(0x5580650d3640 msgr2=0x5580651a55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.108+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 shutdown_connections 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe435cd0b80 1 -- 172.21.15.43:0/799289585 wait complete. 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe435cd0b80 20 client.14964 trim_cache size 0 max 16384 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24448, 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:48:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 134.634161761, 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 176.55925334899999 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 msgr2=0x7fe4100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 0x7fe4100a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe424076d60 tx=0x7fe414005f50 comp rx=0 tx=0).stop 2024-04-25T20:48:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 msgr2=0x7fe42419b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe420000c00 tx=0x7fe420004580 comp rx=0 tx=0).stop 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 shutdown_connections 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe4100a3c40 0x7fe4100a6100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe424108a50 0x7fe42419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe424102a90 0x7fe42419b450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 --2- 172.21.15.43:0/1068534799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe424103450 0x7fe42419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.109+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 >> 172.21.15.43:0/1068534799 conn(0x7fe424079ba0 msgr2=0x7fe424101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.110+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 shutdown_connections 2024-04-25T20:48:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:48:58.110+0000 7fe42b447700 1 -- 172.21.15.43:0/1068534799 wait complete. 2024-04-25T20:48:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:57 smithi195 ceph-mon[33250]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:58.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:57 smithi112 ceph-mon[32322]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:48:58.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-25T20:48:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:00.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:48:59 smithi043 ceph-mon[29167]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:00.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:48:59 smithi195 ceph-mon[33250]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:00.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:48:59 smithi112 ceph-mon[32322]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:00.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/369458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 msgr2=0x7fb8b010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/369458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b010f930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b0a0 tx=0x7fb8a800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/369458797 shutdown_connections 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/369458797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b010f930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/369458797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 0x7fb8b0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/369458797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 0x7fb8b006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/369458797 >> 172.21.15.43:0/369458797 conn(0x7fb8b00789e0 msgr2=0x7fb8b0078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/369458797 shutdown_connections 2024-04-25T20:49:00.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/369458797 wait complete. 2024-04-25T20:49:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.908+0000 7fb8b4f4f700 1 Processor -- start 2024-04-25T20:49:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 -- start start 2024-04-25T20:49:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 0x7fb8b019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 0x7fb8b019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0112dc0 con 0x7fb8b006bbb0 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0112c40 con 0x7fb8b0108a60 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8b4f4f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0112f40 con 0x7fb8b006b1f0 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35826/0 (socket says 172.21.15.43:35826) 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 -- 172.21.15.43:0/3364994708 learned_addr learned my addr 172.21.15.43:0/3364994708 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 0x7fb8b019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 0x7fb8b019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 -- 172.21.15.43:0/3364994708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 msgr2=0x7fb8b019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 0x7fb8b019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 -- 172.21.15.43:0/3364994708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 msgr2=0x7fb8b019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 0x7fb8b019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 -- 172.21.15.43:0/3364994708 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b01a0360 con 0x7fb8b006bbb0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.909+0000 7fb8add9b700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400b530 tx=0x7fb8a400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.910+0000 7fb89f7fe700 1 -- 172.21.15.43:0/3364994708 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4015020 con 0x7fb8b006bbb0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.910+0000 7fb89f7fe700 1 -- 172.21.15.43:0/3364994708 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8a4011d00 con 0x7fb8b006bbb0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.910+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b01a0650 con 0x7fb8b006bbb0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.910+0000 7fb89f7fe700 1 -- 172.21.15.43:0/3364994708 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4010e40 con 0x7fb8b006bbb0 2024-04-25T20:49:00.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.910+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b01a7ed0 con 0x7fb8b006bbb0 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.912+0000 7fb89f7fe700 1 -- 172.21.15.43:0/3364994708 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb8a4018020 con 0x7fb8b006bbb0 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.912+0000 7fb89f7fe700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 0x7fb8980a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.913+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 0x7fb8980a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.913+0000 7fb89f7fe700 1 -- 172.21.15.43:0/3364994708 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb8a40cfb00 con 0x7fb8b006bbb0 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.913+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 0x7fb8980a6180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000ac50 tx=0x7fb8a000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.913+0000 7fb8bf7d8b80 1 Processor -- start 2024-04-25T20:49:00.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 -- start start 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b475bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 0x555a2b47a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555a2b3c7ce0 con 0x555a2b4760f0 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555a2b36e910 con 0x555a2b4757d0 2024-04-25T20:49:00.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555a2b3c3ca0 con 0x555a2b47a580 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35834/0 (socket says 172.21.15.43:35834) 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 -- 172.21.15.43:0/2815578089 learned_addr learned my addr 172.21.15.43:0/2815578089 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b475bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 0x555a2b47a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 -- 172.21.15.43:0/2815578089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 msgr2=0x555a2b47a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 0x555a2b47a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 -- 172.21.15.43:0/2815578089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 msgr2=0x555a2b475bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.914+0000 7fb8add9b700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b475bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb8add9b700 1 -- 172.21.15.43:0/2815578089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2b315880 con 0x555a2b4760f0 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 0x555a2b47a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:00.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b475bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb8add9b700 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40a44d0 tx=0x7fb8a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bdb3ff1bf345ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb89cff9700 1 -- 172.21.15.43:0/2815578089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40b5070 con 0x555a2b4760f0 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb89cff9700 1 -- 172.21.15.43:0/2815578089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8a409c490 con 0x555a2b4760f0 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.915+0000 7fb89cff9700 1 -- 172.21.15.43:0/2815578089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40b5210 con 0x555a2b4760f0 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2815578089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 msgr2=0x555a2b47a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40a44d0 tx=0x7fb8a4004750 comp rx=0 tx=0).stop 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2815578089 shutdown_connections 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b47a580 0x555a2b47a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b475bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2815578089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b4760f0 0x555a2b47a040 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2815578089 >> 172.21.15.43:0/2815578089 conn(0x555a2b3a2640 msgr2=0x555a2b470820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2815578089 shutdown_connections 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2815578089 wait complete. 2024-04-25T20:49:00.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 -- start start 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.916+0000 7fb8bf7d8b80 1 Processor -- start 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b47ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555a2b482610 con 0x555a2b47a580 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555a2b366b80 con 0x555a2b4757d0 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555a2b482790 con 0x555a2b4760f0 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8bf7d8b80 10 client.0 _ll_register_callbacks cb 0x555a2b360900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35848/0 (socket says 172.21.15.43:35848) 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8ae59c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:35692/0 (socket says 172.21.15.43:35692) 2024-04-25T20:49:00.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 -- 172.21.15.43:0/1653650698 learned_addr learned my addr 172.21.15.43:0/1653650698 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8add9b700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b47ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 -- 172.21.15.43:0/1653650698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 msgr2=0x555a2b47ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b47ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 -- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 msgr2=0x555a2b481b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 -- 172.21.15.43:0/1653650698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2b37f220 con 0x555a2b47a580 2024-04-25T20:49:00.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8add9b700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b47ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009e30 tx=0x7fb8a8003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3c9777ff0b0e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.917+0000 7fb895ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80076e0 con 0x555a2b47a580 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb8a8007880 con 0x555a2b47a580 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8a409c490 con 0x555a2b47a580 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8a8007a80 con 0x555a2b47a580 2024-04-25T20:49:00.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 10 client.14976 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a2b48cf20 con 0x555a2b47a580 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8a409c490 con 0x555a2b47a580 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb8a8011070 con 0x555a2b47a580 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 10 client.14976 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 10 client.14976 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 20 client.14976 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b48f970 0x555a2b490de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 4 client.14976 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.918+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a2b3d54d0 con 0x555a2b48f970 2024-04-25T20:49:00.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.919+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b48f970 0x555a2b490de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.919+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b48f970 0x555a2b490de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1497412b5a126fd9 server_cookie=33bf6507e60704b1 in_seq=0 out_seq=0 2024-04-25T20:49:00.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.919+0000 7fb895ffb700 10 client.14976 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:00.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb895ffb700 1 -- 172.21.15.43:0/1653650698 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a2b3d54d0 con 0x555a2b48f970 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb895ffb700 10 client.14976 handle_command_reply: tid=0 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 client.14976 shutdown 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 msgr2=0x555a2b47f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009e30 tx=0x7fb8a8003a00 comp rx=0 tx=0).stop 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 shutdown_connections 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b47f340 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b481b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b48f970 0x555a2b490de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/1653650698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b47ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 >> 172.21.15.43:0/1653650698 conn(0x555a2b3a2640 msgr2=0x555a2b47b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.920+0000 7fb895ffb700 0 client.14976 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.921+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 shutdown_connections 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.921+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/1653650698 wait complete. 2024-04-25T20:49:00.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.921+0000 7fb8bf7d8b80 20 client.14976 trim_cache size 0 max 16384 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 Processor -- start 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 -- start start 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b47f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b48eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555a2b48f120 con 0x555a2b47a580 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555a2b48f7f0 con 0x555a2b4757d0 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.942+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555a2b48fec0 con 0x555a2b4760f0 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35850/0 (socket says 172.21.15.43:35850) 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 -- 172.21.15.43:0/2418607242 learned_addr learned my addr 172.21.15.43:0/2418607242 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b47f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8add9b700 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b48eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 -- 172.21.15.43:0/2418607242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 msgr2=0x555a2b48eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b48eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 -- 172.21.15.43:0/2418607242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 msgr2=0x555a2b47f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b47f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 -- 172.21.15.43:0/2418607242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2b482740 con 0x555a2b47a580 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000f80 tx=0x7fb8a800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e816edb8d270dba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb897fff700 1 -- 172.21.15.43:0/2418607242 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8035070 con 0x555a2b47a580 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb897fff700 1 -- 172.21.15.43:0/2418607242 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8a8005e60 con 0x555a2b47a580 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.943+0000 7fb897fff700 1 -- 172.21.15.43:0/2418607242 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8027a00 con 0x555a2b47a580 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2418607242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 msgr2=0x555a2b4745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8000f80 tx=0x7fb8a800beb0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2418607242 shutdown_connections 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b4745e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4757d0 0x555a2b47f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/2418607242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4760f0 0x555a2b48eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2418607242 >> 172.21.15.43:0/2418607242 conn(0x555a2b3a2640 msgr2=0x555a2b48e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2418607242 shutdown_connections 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/2418607242 wait complete. 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 -- start start 2024-04-25T20:49:00.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.944+0000 7fb8bf7d8b80 1 Processor -- start 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4760f0 0x555a2b4937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b493d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555a2b490c60 con 0x555a2b47a580 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555a2b490590 con 0x555a2b4760f0 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555a2b491330 con 0x555a2b4757d0 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8bf7d8b80 10 client.0 _ll_register_callbacks cb 0x555a2b360900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:00.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:38440/0 (socket says 172.21.15.43:38440) 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 -- 172.21.15.43:0/44175609 learned_addr learned my addr 172.21.15.43:0/44175609 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8add9b700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4760f0 0x555a2b4937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b493d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 -- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4760f0 msgr2=0x555a2b4937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4760f0 0x555a2b4937e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 -- 172.21.15.43:0/44175609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 msgr2=0x555a2b493d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b493d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 -- 172.21.15.43:0/44175609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2b4942b0 con 0x555a2b4757d0 2024-04-25T20:49:00.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8aed9d700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b493d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb8ae59c700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00046e0 tx=0x7fb8a00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f3492e8ac60767c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.945+0000 7fb895ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0016070 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a2b3cf570 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb8a00297c0 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8a0039050 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 10 client.24718 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a2b498d00 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x555a2b3cf570 con 0x555a2b4757d0 2024-04-25T20:49:00.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb8a001e4a0 con 0x555a2b4757d0 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 10 client.24718 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 10 client.24718 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 20 client.24718 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b4fb4d0 0x555a2b4fa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 4 client.24718 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.946+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "status"}) -- 0x555a2b248200 con 0x555a2b4fb4d0 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8add9b700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b4fb4d0 0x555a2b4fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8add9b700 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b4fb4d0 0x555a2b4fa1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93d24a7ed6eae8e2 server_cookie=b5a77de5b7d9de02 in_seq=0 out_seq=0 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb895ffb700 10 client.24718 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb895ffb700 1 -- 172.21.15.43:0/44175609 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555a2b248200 con 0x555a2b4fb4d0 2024-04-25T20:49:00.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb895ffb700 10 client.24718 handle_command_reply: tid=0 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 client.24718 shutdown 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 msgr2=0x555a2b49a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00046e0 tx=0x7fb8a00047c0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 shutdown_connections 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x555a2b4fb4d0 0x555a2b4fa1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555a2b4757d0 0x555a2b49a420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555a2b47a580 0x555a2b493d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb895ffb700 0 client.24718 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 --2- 172.21.15.43:0/44175609 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555a2b4760f0 0x555a2b4937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 >> 172.21.15.43:0/44175609 conn(0x555a2b3a2640 msgr2=0x555a2b4745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 shutdown_connections 2024-04-25T20:49:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 1 -- 172.21.15.43:0/44175609 wait complete. 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.947+0000 7fb8bf7d8b80 20 client.24718 trim_cache size 0 max 16384 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24449, 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 138.485096664, 2024-04-25T20:49:00.957 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:00.958 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:00.958 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:00.958 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 182.40437581099999 2024-04-25T20:49:00.958 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 msgr2=0x7fb8980a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 0x7fb8980a6180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000ac50 tx=0x7fb8a000a380 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 msgr2=0x7fb8b019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400b530 tx=0x7fb8a400b840 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 shutdown_connections 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb8980a3cc0 0x7fb8980a6180 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8b006b1f0 0x7fb8b019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb8b0108a60 0x7fb8b019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 --2- 172.21.15.43:0/3364994708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8b006bbb0 0x7fb8b019b890 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 >> 172.21.15.43:0/3364994708 conn(0x7fb8b00789e0 msgr2=0x7fb8b010ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 shutdown_connections 2024-04-25T20:49:00.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:00.948+0000 7fb8b4f4f700 1 -- 172.21.15.43:0/3364994708 wait complete. 2024-04-25T20:49:01.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-25T20:49:01.967 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:01 smithi043 ceph-mon[29167]: pgmap v379: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:02.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:01 smithi195 ceph-mon[33250]: pgmap v379: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:02.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:01 smithi112 ceph-mon[32322]: pgmap v379: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:03.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 -- 172.21.15.43:0/3856453993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc06bb10 msgr2=0x7f59fc10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 --2- 172.21.15.43:0/3856453993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc06bb10 0x7f59fc10ef50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009990 tx=0x7f59ec009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 -- 172.21.15.43:0/3856453993 shutdown_connections 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 --2- 172.21.15.43:0/3856453993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06b1f0 0x7f59fc06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 --2- 172.21.15.43:0/3856453993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc10f490 0x7f59fc111880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 --2- 172.21.15.43:0/3856453993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc06bb10 0x7f59fc10ef50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 -- 172.21.15.43:0/3856453993 >> 172.21.15.43:0/3856453993 conn(0x7f59fc0789e0 msgr2=0x7f59fc078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 -- 172.21.15.43:0/3856453993 shutdown_connections 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.766+0000 7f5a04063700 1 -- 172.21.15.43:0/3856453993 wait complete. 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 Processor -- start 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 -- start start 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc06b1f0 0x7f59fc19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06bb10 0x7f59fc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc115000 con 0x7f59fc10f490 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc114e80 con 0x7f59fc06b1f0 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a04063700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc115180 con 0x7f59fc06bb10 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35876/0 (socket says 172.21.15.43:35876) 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a02600700 1 -- 172.21.15.43:0/3531046056 learned_addr learned my addr 172.21.15.43:0/3531046056 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a015fe700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06bb10 0x7f59fc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.767+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc06b1f0 0x7f59fc19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 -- 172.21.15.43:0/3531046056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06bb10 msgr2=0x7f59fc19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06bb10 0x7f59fc19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 -- 172.21.15.43:0/3531046056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc06b1f0 msgr2=0x7f59fc19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc06b1f0 0x7f59fc19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 -- 172.21.15.43:0/3531046056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc1a0420 con 0x7f59fc10f490 2024-04-25T20:49:03.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a02600700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007d40 tx=0x7f59f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f59f2ffd700 1 -- 172.21.15.43:0/3531046056 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4016020 con 0x7f59fc10f490 2024-04-25T20:49:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f59f2ffd700 1 -- 172.21.15.43:0/3531046056 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59f400ac90 con 0x7f59fc10f490 2024-04-25T20:49:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc1a0710 con 0x7f59fc10f490 2024-04-25T20:49:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f59f2ffd700 1 -- 172.21.15.43:0/3531046056 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f40115e0 con 0x7f59fc10f490 2024-04-25T20:49:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.768+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc1a7f90 con 0x7f59fc10f490 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.770+0000 7f59f2ffd700 1 -- 172.21.15.43:0/3531046056 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f59f4019020 con 0x7f59fc10f490 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.771+0000 7f59f2ffd700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 0x7f59e80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.771+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 0x7f59e80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.771+0000 7f59f2ffd700 1 -- 172.21.15.43:0/3531046056 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f59f40d0370 con 0x7f59fc10f490 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.771+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 0x7f59e80a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009a10 tx=0x7f59f8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 Processor -- start 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 -- start start 2024-04-25T20:49:03.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85ca7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55df85bf9ce0 con 0x55df85cac580 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df85ba0910 con 0x55df85ca77d0 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55df85bf5ca0 con 0x55df85ca80f0 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35882/0 (socket says 172.21.15.43:35882) 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a01dff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85ca7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a02600700 1 -- 172.21.15.43:0/3878556545 learned_addr learned my addr 172.21.15.43:0/3878556545 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.772+0000 7f5a015fe700 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 -- 172.21.15.43:0/3878556545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 msgr2=0x55df85cac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 -- 172.21.15.43:0/3878556545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 msgr2=0x55df85ca7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85ca7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 -- 172.21.15.43:0/3878556545 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df85b47880 con 0x55df85cac580 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85ca7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f5a02600700 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59f4098a60 tx=0x7f59f409c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853be83dab2aee7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f59e7fff700 1 -- 172.21.15.43:0/3878556545 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4098040 con 0x55df85cac580 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f59e7fff700 1 -- 172.21.15.43:0/3878556545 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59f400ae40 con 0x55df85cac580 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.773+0000 7f59e7fff700 1 -- 172.21.15.43:0/3878556545 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f40a4de0 con 0x55df85cac580 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3878556545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 msgr2=0x55df85cac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59f4098a60 tx=0x7f59f409c090 comp rx=0 tx=0).stop 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3878556545 shutdown_connections 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cac9e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85ca7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3878556545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3878556545 >> 172.21.15.43:0/3878556545 conn(0x55df85bd4640 msgr2=0x55df85ca2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3878556545 shutdown_connections 2024-04-25T20:49:03.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3878556545 wait complete. 2024-04-25T20:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 -- start start 2024-04-25T20:49:03.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.774+0000 7f5a0e8ecb80 1 Processor -- start 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 0x55df85cb3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cb0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55df85cb4610 con 0x55df85ca77d0 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df85b98b80 con 0x55df85cac580 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55df85cb4790 con 0x55df85ca80f0 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a0e8ecb80 10 client.0 _ll_register_callbacks cb 0x55df85b92900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:35738/0 (socket says 172.21.15.43:35738) 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 -- 172.21.15.43:0/3322463515 learned_addr learned my addr 172.21.15.43:0/3322463515 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a015fe700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cb0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a01dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 0x55df85cb3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 -- 172.21.15.43:0/3322463515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 msgr2=0x55df85cb0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cb0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 -- 172.21.15.43:0/3322463515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 msgr2=0x55df85cb3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 0x55df85cb3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a02600700 1 -- 172.21.15.43:0/3322463515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df85bb1220 con 0x55df85cac580 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.775+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 0x55df85cb3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a02600700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59f409c300 tx=0x7f59f409cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd24ab40f04ba71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T20:49:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f40a09b0 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55df85c074d0 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f59f40a4de0 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f59f40a4fe0 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 10 client.24773 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55df85cb4610 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55df85c074d0 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f59f409ba50 con 0x55df85cac580 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 10 client.24773 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 10 client.24773 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 20 client.24773 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85cc0f30 0x55df85cc23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 4 client.24773 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.776+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df85c01570 con 0x55df85cc0f30 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.777+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85cc0f30 0x55df85cc23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.777+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85cc0f30 0x55df85cc23a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b84372e3c752d3b server_cookie=dffb966afcb5b22b in_seq=0 out_seq=0 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.777+0000 7f59e57fa700 10 client.24773 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f59e57fa700 1 -- 172.21.15.43:0/3322463515 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55df85c01570 con 0x55df85cc0f30 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f59e57fa700 10 client.24773 handle_command_reply: tid=0 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 client.24773 shutdown 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 msgr2=0x55df85cb1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59f409c300 tx=0x7f59f409cd00 comp rx=0 tx=0).stop 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 shutdown_connections 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85cc0f30 0x55df85cc23a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85cac580 0x55df85cb1280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca77d0 0x55df85cb3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3322463515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca80f0 0x55df85cb0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f59e57fa700 0 client.24773 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 >> 172.21.15.43:0/3322463515 conn(0x55df85bd4640 msgr2=0x55df85cad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 shutdown_connections 2024-04-25T20:49:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3322463515 wait complete. 2024-04-25T20:49:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.778+0000 7f5a0e8ecb80 20 client.24773 trim_cache size 0 max 16384 2024-04-25T20:49:03.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 Processor -- start 2024-04-25T20:49:03.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 -- start start 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 0x55df85caffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 0x55df85ca6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc06e0 con 0x55df85cac580 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc0db0 con 0x55df85ca80f0 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc1480 con 0x55df85ca77d0 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35906/0 (socket says 172.21.15.43:35906) 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 -- 172.21.15.43:0/3624898784 learned_addr learned my addr 172.21.15.43:0/3624898784 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a015fe700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 0x55df85ca6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 -- 172.21.15.43:0/3624898784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 msgr2=0x55df85caffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 0x55df85caffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 0x55df85caffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 -- 172.21.15.43:0/3624898784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 msgr2=0x55df85ca6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 0x55df85ca6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a02600700 1 -- 172.21.15.43:0/3624898784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df85cb22e0 con 0x55df85cac580 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a015fe700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 0x55df85ca6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.799+0000 7f5a01dff700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 0x55df85caffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a02600700 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f59f409c540 tx=0x7f59f4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98235810904a4dde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f59e77fe700 1 -- 172.21.15.43:0/3624898784 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4098030 con 0x55df85cac580 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f59e77fe700 1 -- 172.21.15.43:0/3624898784 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59f40ba070 con 0x55df85cac580 2024-04-25T20:49:03.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f59e77fe700 1 -- 172.21.15.43:0/3624898784 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4085b90 con 0x55df85cac580 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3624898784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 msgr2=0x55df85cae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f59f409c540 tx=0x7f59f4018fb0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3624898784 shutdown_connections 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85ca77d0 0x55df85caffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85cac580 0x55df85cae0d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/3624898784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca80f0 0x55df85ca6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3624898784 >> 172.21.15.43:0/3624898784 conn(0x55df85bd4640 msgr2=0x55df85ca65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3624898784 shutdown_connections 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.800+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/3624898784 wait complete. 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 -- start start 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 Processor -- start 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85cad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85cac580 0x55df85cae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc2220 con 0x55df85ca80f0 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc1b50 con 0x55df85ca77d0 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55df85cc28f0 con 0x55df85cac580 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a0e8ecb80 10 client.0 _ll_register_callbacks cb 0x55df85b92900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a015fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a015fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35918/0 (socket says 172.21.15.43:35918) 2024-04-25T20:49:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.801+0000 7f5a015fe700 1 -- 172.21.15.43:0/209365728 learned_addr learned my addr 172.21.15.43:0/209365728 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a01dff700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85cad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a02600700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85cac580 0x55df85cae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 -- 172.21.15.43:0/209365728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85cac580 msgr2=0x55df85cae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85cac580 0x55df85cae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 -- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 msgr2=0x55df85cad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85cad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 -- 172.21.15.43:0/209365728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df85cc7aa0 con 0x55df85ca80f0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a01dff700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85cad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a015fe700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009990 tx=0x7f59ec003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefa4105a39f5cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f59e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec003ce0 con 0x55df85ca80f0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f59ec0050d0 con 0x55df85ca80f0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f40ba070 con 0x55df85ca80f0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f59ec034050 con 0x55df85ca80f0 2024-04-25T20:49:03.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a0e8ecb80 10 client.15000 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.802+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55df85d28310 con 0x55df85ca80f0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59f40ba070 con 0x55df85ca80f0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f59ec00fc20 con 0x55df85ca80f0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 10 client.15000 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 20 client.15000 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85d2cfc0 0x55df85d2bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 4 client.15000 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "status"}) -- 0x55df85a7a200 con 0x55df85d2cfc0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a01dff700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85d2cfc0 0x55df85d2bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f59e57fa700 10 client.15000 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.803+0000 7f5a01dff700 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85d2cfc0 0x55df85d2bcd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ba0f6037a6b9790 server_cookie=d9111c3280636d3e in_seq=0 out_seq=0 2024-04-25T20:49:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f59e57fa700 1 -- 172.21.15.43:0/209365728 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55df85a7a200 con 0x55df85d2cfc0 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f59e57fa700 10 client.15000 handle_command_reply: tid=0 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 client.15000 shutdown 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 msgr2=0x55df85cadf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009990 tx=0x7f59ec003680 comp rx=0 tx=0).stop 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 shutdown_connections 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55df85d2cfc0 0x55df85d2bcd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55df85cac580 0x55df85cae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55df85ca77d0 0x55df85cad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f59e57fa700 0 client.15000 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 --2- 172.21.15.43:0/209365728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55df85ca80f0 0x55df85cadf00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 >> 172.21.15.43:0/209365728 conn(0x55df85bd4640 msgr2=0x55df85ca6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 shutdown_connections 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 1 -- 172.21.15.43:0/209365728 wait complete. 2024-04-25T20:49:03.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.804+0000 7f5a0e8ecb80 20 client.15000 trim_cache size 0 max 16384 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24470, 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 155.31697956299999, 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 171.45509486500001 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 msgr2=0x7f59e80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 0x7f59e80a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009a10 tx=0x7f59f8009190 comp rx=0 tx=0).stop 2024-04-25T20:49:03.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 msgr2=0x7f59fc19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007d40 tx=0x7f59f400a340 comp rx=0 tx=0).stop 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 shutdown_connections 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f59e80a3c40 0x7f59e80a6100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59fc10f490 0x7f59fc19fce0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59fc06b1f0 0x7f59fc19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 --2- 172.21.15.43:0/3531046056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59fc06bb10 0x7f59fc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 >> 172.21.15.43:0/3531046056 conn(0x7f59fc0789e0 msgr2=0x7f59fc1108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 shutdown_connections 2024-04-25T20:49:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:03.805+0000 7f5a04063700 1 -- 172.21.15.43:0/3531046056 wait complete. 2024-04-25T20:49:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:03 smithi043 ceph-mon[29167]: pgmap v380: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:04.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:03 smithi195 ceph-mon[33250]: pgmap v380: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:04.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:03 smithi112 ceph-mon[32322]: pgmap v380: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:04.669 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T20:49:04.670 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T20:49:04.679 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:49:04.680 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T20:49:04.939 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:06.203 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:05 smithi043 ceph-mon[29167]: pgmap v381: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:05 smithi195 ceph-mon[33250]: pgmap v381: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:06.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:05 smithi112 ceph-mon[32322]: pgmap v381: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/931908703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc103540 msgr2=0x7f5dbc109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/931908703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc103540 0x7f5dbc109df0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5db400b0d0 tx=0x7f5db400b3e0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/931908703 shutdown_connections 2024-04-25T20:49:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/931908703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/931908703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc103540 0x7f5dbc109df0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/931908703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dbc102ba0 0x7f5dbc103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/931908703 >> 172.21.15.43:0/931908703 conn(0x7f5dbc0fcf40 msgr2=0x7f5dbc0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/931908703 shutdown_connections 2024-04-25T20:49:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.658+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/931908703 wait complete. 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 Processor -- start 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 -- start start 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc102ba0 0x7f5dbc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dbc103540 0x7f5dbc1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc10d580 con 0x7f5dbc1019a0 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc10d400 con 0x7f5dbc103540 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc2f9c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc10d700 con 0x7f5dbc102ba0 2024-04-25T20:49:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38138/0 (socket says 172.21.15.43:38138) 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 -- 172.21.15.43:0/447097543 learned_addr learned my addr 172.21.15.43:0/447097543 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dbbfff700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc102ba0 0x7f5dbc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 -- 172.21.15.43:0/447097543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc102ba0 msgr2=0x7f5dbc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc102ba0 0x7f5dbc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 -- 172.21.15.43:0/447097543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dbc103540 msgr2=0x7f5dbc1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dbc103540 0x7f5dbc1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 -- 172.21.15.43:0/447097543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dbc1a0940 con 0x7f5dbc1019a0 2024-04-25T20:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.659+0000 7f5dc0d38700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d980 tx=0x7f5db000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.660+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0017070 con 0x7f5dbc1019a0 2024-04-25T20:49:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.660+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dbc1a0c30 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.660+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5db0009b40 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.660+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db000f620 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.660+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dbc1a1120 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.661+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dbc069730 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.662+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f5db0009cf0 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.662+0000 7f5db9ffb700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 0x7f5dac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.662+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f5db00cff90 con 0x7f5dbc1019a0 2024-04-25T20:49:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.662+0000 7f5dbbfff700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 0x7f5dac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.663+0000 7f5dbbfff700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 0x7f5dac0a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5da8005fd0 tx=0x7f5da800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.667+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5db009ca20 con 0x7f5dbc1019a0 2024-04-25T20:49:06.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.894+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5dbc06ae30 con 0x7f5dac0a3c40 2024-04-25T20:49:06.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.895+0000 7f5db9ffb700 1 -- 172.21.15.43:0/447097543 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5dbc06ae30 con 0x7f5dac0a3c40 2024-04-25T20:49:06.896 INFO:teuthology.orchestra.run.smithi043.stdout:Backend: cephadm 2024-04-25T20:49:06.896 INFO:teuthology.orchestra.run.smithi043.stdout:Available: Yes 2024-04-25T20:49:06.896 INFO:teuthology.orchestra.run.smithi043.stdout:Paused: No 2024-04-25T20:49:06.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 msgr2=0x7f5dac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:06.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 0x7f5dac0a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5da8005fd0 tx=0x7f5da800a560 comp rx=0 tx=0).stop 2024-04-25T20:49:06.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 msgr2=0x7f5dbc198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:06.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d980 tx=0x7f5db000dd40 comp rx=0 tx=0).stop 2024-04-25T20:49:06.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 shutdown_connections 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f5dac0a3c40 0x7f5dac0a6100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5dbc103540 0x7f5dbc1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dbc1019a0 0x7f5dbc198d40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 --2- 172.21.15.43:0/447097543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dbc102ba0 0x7f5dbc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.897+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 >> 172.21.15.43:0/447097543 conn(0x7f5dbc0fcf40 msgr2=0x7f5dbc06a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.898+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 shutdown_connections 2024-04-25T20:49:06.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:06.898+0000 7f5dc2f9c700 1 -- 172.21.15.43:0/447097543 wait complete. 2024-04-25T20:49:07.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T20:49:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:07 smithi043 ceph-mon[29167]: pgmap v382: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:49:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:07 smithi043 ceph-mon[29167]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:07 smithi195 ceph-mon[33250]: pgmap v382: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:49:08.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:07 smithi195 ceph-mon[33250]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:07 smithi112 ceph-mon[32322]: pgmap v382: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-04-25T20:49:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:07 smithi112 ceph-mon[32322]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 -- 172.21.15.43:0/3617779600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc8102ba0 msgr2=0x7f0dc8103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 --2- 172.21.15.43:0/3617779600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc8102ba0 0x7f0dc8103000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0db00099c0 tx=0x7f0db0009cd0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 -- 172.21.15.43:0/3617779600 shutdown_connections 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 --2- 172.21.15.43:0/3617779600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc81019a0 0x7f0dc8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 --2- 172.21.15.43:0/3617779600 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc8109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 --2- 172.21.15.43:0/3617779600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc8102ba0 0x7f0dc8103000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 -- 172.21.15.43:0/3617779600 >> 172.21.15.43:0/3617779600 conn(0x7f0dc80fcf40 msgr2=0x7f0dc80ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 -- 172.21.15.43:0/3617779600 shutdown_connections 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.710+0000 7f0dccb82700 1 -- 172.21.15.43:0/3617779600 wait complete. 2024-04-25T20:49:09.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 Processor -- start 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 -- start start 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc8102ba0 0x7f0dc81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc81a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc810d5f0 con 0x7f0dc81019a0 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc810d470 con 0x7f0dc8103540 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dccb82700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc810d770 con 0x7f0dc8102ba0 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38148/0 (socket says 172.21.15.43:38148) 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc659c700 1 -- 172.21.15.43:0/571654015 learned_addr learned my addr 172.21.15.43:0/571654015 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:09.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc6d9d700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc81a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc5d9b700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc8102ba0 0x7f0dc81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc659c700 1 -- 172.21.15.43:0/571654015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc8102ba0 msgr2=0x7f0dc81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.711+0000 7f0dc659c700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc8102ba0 0x7f0dc81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dc659c700 1 -- 172.21.15.43:0/571654015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 msgr2=0x7f0dc81a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dc659c700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc81a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dc659c700 1 -- 172.21.15.43:0/571654015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc81a0a00 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dc6d9d700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc81a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dc659c700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b9f0 tx=0x7f0db800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8019070 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0db8014440 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc81a0cf0 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db80125a0 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.712+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc81a1180 con 0x7f0dc81019a0 2024-04-25T20:49:09.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.713+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc81a1410 con 0x7f0dc81019a0 2024-04-25T20:49:09.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.714+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f0db801c070 con 0x7f0dc81019a0 2024-04-25T20:49:09.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.715+0000 7f0dbf7fe700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 0x7f0db40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:09.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.715+0000 7f0dc5d9b700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 0x7f0db40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:09.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.715+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f0db80cf850 con 0x7f0dc81019a0 2024-04-25T20:49:09.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.715+0000 7f0dc5d9b700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 0x7f0db40a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0db0003910 tx=0x7f0db0005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:09.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.720+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0db809c1e0 con 0x7f0dc81019a0 2024-04-25T20:49:09.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.940+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0dc81a15e0 con 0x7f0db40a3c40 2024-04-25T20:49:09.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.954+0000 7f0dbf7fe700 1 -- 172.21.15.43:0/571654015 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f0dc81a15e0 con 0x7f0db40a3c40 2024-04-25T20:49:09.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:09 smithi043 ceph-mon[29167]: pgmap v383: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:09.956 INFO:teuthology.orchestra.run.smithi043.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T20:49:09.956 INFO:teuthology.orchestra.run.smithi043.stdout:mds.a smithi043 running (3m) 38s ago 3m 19.1M - 19.0.0-3156-gd69f13d8 da4b004c09e8 f302bc12a12f 2024-04-25T20:49:09.956 INFO:teuthology.orchestra.run.smithi043.stdout:mds.b smithi112 running (2m) 42s ago 2m 26.6M - 19.0.0-3156-gd69f13d8 da4b004c09e8 ebebc2079ac5 2024-04-25T20:49:09.956 INFO:teuthology.orchestra.run.smithi043.stdout:mds.c smithi195 running (3m) 42s ago 3m 19.7M - 19.0.0-3156-gd69f13d8 da4b004c09e8 ff7137b97844 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.d smithi043 running (3m) 38s ago 3m 14.3M - 19.0.0-3156-gd69f13d8 da4b004c09e8 af98139affe5 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.e smithi112 running (3m) 42s ago 3m 21.7M - 19.0.0-3156-gd69f13d8 da4b004c09e8 81d3c9031518 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.f smithi195 running (3m) 42s ago 3m 19.8M - 19.0.0-3156-gd69f13d8 da4b004c09e8 7de9ab3d0fe7 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.g smithi043 running (3m) 38s ago 3m 20.5M - 19.0.0-3156-gd69f13d8 da4b004c09e8 7ff145139d21 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.h smithi112 running (3m) 42s ago 3m 21.2M - 19.0.0-3156-gd69f13d8 da4b004c09e8 ac4d2d285f37 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.i smithi195 running (3m) 42s ago 3m 18.8M - 19.0.0-3156-gd69f13d8 da4b004c09e8 2f463b54da63 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.j smithi043 running (3m) 38s ago 3m 15.9M - 19.0.0-3156-gd69f13d8 da4b004c09e8 4afa2628f46e 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.k smithi112 running (3m) 42s ago 3m 19.2M - 19.0.0-3156-gd69f13d8 da4b004c09e8 d63ff1abad02 2024-04-25T20:49:09.957 INFO:teuthology.orchestra.run.smithi043.stdout:mds.l smithi195 running (3m) 42s ago 3m 21.4M - 19.0.0-3156-gd69f13d8 da4b004c09e8 cda06cd8fbff 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.x smithi043 *:9283,8765 running (10m) 38s ago 10m 515M - 19.0.0-3156-gd69f13d8 da4b004c09e8 229870cb9d86 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.y smithi112 *:8443,8765 running (8m) 42s ago 8m 453M - 19.0.0-3156-gd69f13d8 da4b004c09e8 5f4c642dcf0f 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mgr.z smithi195 *:8443,8765 running (8m) 42s ago 8m 455M - 19.0.0-3156-gd69f13d8 da4b004c09e8 905c6976b472 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a smithi043 running (11m) 38s ago 11m 56.2M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 994f944184b0 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b smithi112 running (9m) 42s ago 9m 38.4M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 a8e97efb7e06 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c smithi195 running (9m) 42s ago 9m 39.2M 2048M 19.0.0-3156-gd69f13d8 da4b004c09e8 e15bcc0fad98 2024-04-25T20:49:09.958 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 smithi043 running (8m) 38s ago 8m 57.7M 4273M 19.0.0-3156-gd69f13d8 da4b004c09e8 ec56ab97302b 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 smithi112 running (8m) 42s ago 8m 60.2M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 3e49472263a1 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 smithi195 running (7m) 42s ago 7m 47.8M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 4379b1ab265a 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 smithi043 running (7m) 38s ago 7m 54.9M 4273M 19.0.0-3156-gd69f13d8 da4b004c09e8 7d5f23be0e5e 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 smithi112 running (6m) 42s ago 6m 42.2M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 cfc1f18d4f3c 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 smithi195 running (6m) 42s ago 6m 55.8M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 a4e2327ee8ad 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 smithi043 running (6m) 38s ago 6m 45.3M 4273M 19.0.0-3156-gd69f13d8 da4b004c09e8 37c3977a2b19 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 smithi112 running (5m) 42s ago 5m 53.4M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 3563cb907333 2024-04-25T20:49:09.959 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 smithi195 running (5m) 42s ago 5m 56.9M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 f40174c48ccd 2024-04-25T20:49:09.960 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 smithi043 running (4m) 38s ago 4m 42.0M 4273M 19.0.0-3156-gd69f13d8 da4b004c09e8 db23c584a677 2024-04-25T20:49:09.960 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 smithi112 running (4m) 42s ago 4m 54.3M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 186e0c765547 2024-04-25T20:49:09.960 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 smithi195 running (3m) 42s ago 3m 55.8M 4272M 19.0.0-3156-gd69f13d8 da4b004c09e8 d10fe70d2aa7 2024-04-25T20:49:09.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 msgr2=0x7f0db40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:09.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 0x7f0db40a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0db0003910 tx=0x7f0db0005c00 comp rx=0 tx=0).stop 2024-04-25T20:49:09.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 msgr2=0x7f0dc8198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:09.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b9f0 tx=0x7f0db800bdb0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 shutdown_connections 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f0db40a3c40 0x7f0db40a6100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dc8103540 0x7f0dc81a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dc81019a0 0x7f0dc8198da0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 --2- 172.21.15.43:0/571654015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dc8102ba0 0x7f0dc81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 >> 172.21.15.43:0/571654015 conn(0x7f0dc80fcf40 msgr2=0x7f0dc80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 shutdown_connections 2024-04-25T20:49:09.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:09.957+0000 7f0dccb82700 1 -- 172.21.15.43:0/571654015 wait complete. 2024-04-25T20:49:10.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:09 smithi195 ceph-mon[33250]: pgmap v383: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:09 smithi112 ceph-mon[32322]: pgmap v383: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:10.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T20:49:10.933 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:11.195 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:10 smithi043 ceph-mon[29167]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:11.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:10 smithi195 ceph-mon[33250]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:11.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:10 smithi112 ceph-mon[32322]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:12.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:11 smithi043 ceph-mon[29167]: pgmap v384: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:12.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:11 smithi195 ceph-mon[33250]: pgmap v384: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:11 smithi112 ceph-mon[32322]: pgmap v384: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 -- 172.21.15.43:0/1430217182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c103cc0 msgr2=0x7f953c104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 --2- 172.21.15.43:0/1430217182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c103cc0 0x7f953c104120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f95300099c0 tx=0x7f9530009cd0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 -- 172.21.15.43:0/1430217182 shutdown_connections 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 --2- 172.21.15.43:0/1430217182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c102ac0 0x7f953c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 --2- 172.21.15.43:0/1430217182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c104660 0x7f953c10af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 --2- 172.21.15.43:0/1430217182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c103cc0 0x7f953c104120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 -- 172.21.15.43:0/1430217182 >> 172.21.15.43:0/1430217182 conn(0x7f953c0fe060 msgr2=0x7f953c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:12.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 -- 172.21.15.43:0/1430217182 shutdown_connections 2024-04-25T20:49:12.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.737+0000 7f9542b7c700 1 -- 172.21.15.43:0/1430217182 wait complete. 2024-04-25T20:49:12.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 Processor -- start 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 -- start start 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c103cc0 0x7f953c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c104660 0x7f953c1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f953c10e790 con 0x7f953c102ac0 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f953c10e610 con 0x7f953c103cc0 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9542b7c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f953c10e910 con 0x7f953c104660 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38168/0 (socket says 172.21.15.43:38168) 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 -- 172.21.15.43:0/172551491 learned_addr learned my addr 172.21.15.43:0/172551491 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f953bfff700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c103cc0 0x7f953c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9541119700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c104660 0x7f953c1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:12.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 -- 172.21.15.43:0/172551491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c104660 msgr2=0x7f953c1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c104660 0x7f953c1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 -- 172.21.15.43:0/172551491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c103cc0 msgr2=0x7f953c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c103cc0 0x7f953c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.738+0000 7f9540918700 1 -- 172.21.15.43:0/172551491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c1a0a20 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9540918700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b530 tx=0x7f952c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c015020 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f952c011d00 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c1a0d10 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c010e10 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.739+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c1a1220 con 0x7f953c102ac0 2024-04-25T20:49:12.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.740+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c02df80 con 0x7f953c102ac0 2024-04-25T20:49:12.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.741+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f952c018020 con 0x7f953c102ac0 2024-04-25T20:49:12.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.741+0000 7f9539ffb700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 0x7f95240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:12.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.742+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f952c0cfb90 con 0x7f953c102ac0 2024-04-25T20:49:12.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.742+0000 7f953bfff700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 0x7f95240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:12.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.742+0000 7f953bfff700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 0x7f95240a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9530000c00 tx=0x7f9530009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:12.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.746+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f952c01f020 con 0x7f953c102ac0 2024-04-25T20:49:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.962+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f953c062e80 con 0x7f95240a3c40 2024-04-25T20:49:12.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.968+0000 7f9539ffb700 1 -- 172.21.15.43:0/172551491 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f953c062e80 con 0x7f95240a3c40 2024-04-25T20:49:12.969 INFO:teuthology.orchestra.run.smithi043.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T20:49:12.969 INFO:teuthology.orchestra.run.smithi043.stdout:mds.all 12/12 45s ago 3m smithi043=a;smithi043=d;smithi043=g;smithi043=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2024-04-25T20:49:12.969 INFO:teuthology.orchestra.run.smithi043.stdout:mgr 3/3 45s ago 9m smithi043=x;smithi112=y;smithi195=z;count:3 2024-04-25T20:49:12.969 INFO:teuthology.orchestra.run.smithi043.stdout:mon 3/3 45s ago 9m smithi043:172.21.15.43=a;smithi112:172.21.15.112=b;smithi195:172.21.15.195=c;count:3 2024-04-25T20:49:12.969 INFO:teuthology.orchestra.run.smithi043.stdout:osd 12 45s ago - 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 msgr2=0x7f95240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 0x7f95240a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9530000c00 tx=0x7f9530009f10 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 msgr2=0x7f953c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b530 tx=0x7f952c00b840 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 shutdown_connections 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f95240a3c40 0x7f95240a6100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f953c104660 0x7f953c1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f953c102ac0 0x7f953c198dc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 --2- 172.21.15.43:0/172551491 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f953c103cc0 0x7f953c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 >> 172.21.15.43:0/172551491 conn(0x7f953c0fe060 msgr2=0x7f953c106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 shutdown_connections 2024-04-25T20:49:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:12.970+0000 7f9542b7c700 1 -- 172.21.15.43:0/172551491 wait complete. 2024-04-25T20:49:13.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T20:49:14.041 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:13 smithi043 ceph-mon[29167]: pgmap v385: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-25T20:49:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:13 smithi043 ceph-mon[29167]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:13 smithi195 ceph-mon[33250]: pgmap v385: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-25T20:49:14.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:13 smithi195 ceph-mon[33250]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:13 smithi112 ceph-mon[32322]: pgmap v385: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-25T20:49:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:13 smithi112 ceph-mon[32322]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 -- 172.21.15.43:0/1753589470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c1019a0 msgr2=0x7fd21c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 --2- 172.21.15.43:0/1753589470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c1019a0 0x7fd21c101dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0099c0 tx=0x7fd20c009cd0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 -- 172.21.15.43:0/1753589470 shutdown_connections 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 --2- 172.21.15.43:0/1753589470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c103540 0x7fd21c109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 --2- 172.21.15.43:0/1753589470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c1019a0 0x7fd21c101dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 --2- 172.21.15.43:0/1753589470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c102ba0 0x7fd21c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 -- 172.21.15.43:0/1753589470 >> 172.21.15.43:0/1753589470 conn(0x7fd21c0fcf40 msgr2=0x7fd21c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 -- 172.21.15.43:0/1753589470 shutdown_connections 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.901+0000 7fd221727700 1 -- 172.21.15.43:0/1753589470 wait complete. 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 Processor -- start 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 -- start start 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c1019a0 0x7fd21c105a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 0x7fd21c104050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c10d550 con 0x7fd21c103540 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c10d3d0 con 0x7fd21c102ba0 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd221727700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c10d6d0 con 0x7fd21c1019a0 2024-04-25T20:49:15.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49570/0 (socket says 172.21.15.43:49570) 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd21b7fe700 1 -- 172.21.15.43:0/905025889 learned_addr learned my addr 172.21.15.43:0/905025889 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd21affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c1019a0 0x7fd21c105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.902+0000 7fd21a7fc700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 0x7fd21c104050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 -- 172.21.15.43:0/905025889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c1019a0 msgr2=0x7fd21c105a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c1019a0 0x7fd21c105a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 -- 172.21.15.43:0/905025889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 msgr2=0x7fd21c104050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 0x7fd21c104050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 -- 172.21.15.43:0/905025889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c104e40 con 0x7fd21c103540 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21a7fc700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 0x7fd21c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:15.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd21b7fe700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd214007ee0 tx=0x7fd21400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:15.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400dbd0 con 0x7fd21c103540 2024-04-25T20:49:15.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1a2db0 con 0x7fd21c103540 2024-04-25T20:49:15.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd21400dd70 con 0x7fd21c103540 2024-04-25T20:49:15.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214005a50 con 0x7fd21c103540 2024-04-25T20:49:15.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.903+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1a3210 con 0x7fd21c103540 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.904+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c069760 con 0x7fd21c103540 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.905+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fd21401a020 con 0x7fd21c103540 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.906+0000 7fd203fff700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 0x7fd2040a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.906+0000 7fd21affd700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 0x7fd2040a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.906+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fd2140d0260 con 0x7fd21c103540 2024-04-25T20:49:15.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.907+0000 7fd21affd700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 0x7fd2040a62a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009990 tx=0x7fd20c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:15.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:15.910+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd21c069760 con 0x7fd21c103540 2024-04-25T20:49:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:15 smithi043 ceph-mon[29167]: pgmap v386: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.126+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd21c06b880 con 0x7fd2040a3de0 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.127+0000 7fd203fff700 1 -- 172.21.15.43:0/905025889 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd21c06b880 con 0x7fd2040a3de0 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stdout:HOST ADDR LABELS STATUS 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 172.21.15.43 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stdout:smithi112 172.21.15.112 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stdout:smithi195 172.21.15.195 2024-04-25T20:49:16.128 INFO:teuthology.orchestra.run.smithi043.stdout:3 hosts in cluster 2024-04-25T20:49:16.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 msgr2=0x7fd2040a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:16.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 0x7fd2040a62a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009990 tx=0x7fd20c009f10 comp rx=0 tx=0).stop 2024-04-25T20:49:16.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 msgr2=0x7fd21c104590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:16.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd214007ee0 tx=0x7fd21400d3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 shutdown_connections 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fd2040a3de0 0x7fd2040a62a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd21c1019a0 0x7fd21c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c103540 0x7fd21c104590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 --2- 172.21.15.43:0/905025889 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd21c102ba0 0x7fd21c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.129+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 >> 172.21.15.43:0/905025889 conn(0x7fd21c0fcf40 msgr2=0x7fd21c06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.130+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 shutdown_connections 2024-04-25T20:49:16.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:16.130+0000 7fd221727700 1 -- 172.21.15.43:0/905025889 wait complete. 2024-04-25T20:49:16.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:15 smithi195 ceph-mon[33250]: pgmap v386: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:16.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:15 smithi112 ceph-mon[32322]: pgmap v386: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-04-25T20:49:16.864 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T20:49:17.117 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:17.239 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:16 smithi043 ceph-mon[29167]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:17.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:16 smithi195 ceph-mon[33250]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:17.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:16 smithi112 ceph-mon[32322]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:18.244 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:17 smithi112 ceph-mon[32322]: pgmap v387: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:18.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:17 smithi043 ceph-mon[29167]: pgmap v387: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:18.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:17 smithi195 ceph-mon[33250]: pgmap v387: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 -- 172.21.15.43:0/82633189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec103530 msgr2=0x7fc6ec109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 --2- 172.21.15.43:0/82633189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec103530 0x7fc6ec109de0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400b0d0 tx=0x7fc6e400b3e0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 -- 172.21.15.43:0/82633189 shutdown_connections 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 --2- 172.21.15.43:0/82633189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 --2- 172.21.15.43:0/82633189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec103530 0x7fc6ec109de0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 --2- 172.21.15.43:0/82633189 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec102b90 0x7fc6ec102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 -- 172.21.15.43:0/82633189 >> 172.21.15.43:0/82633189 conn(0x7fc6ec0fcf30 msgr2=0x7fc6ec0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 -- 172.21.15.43:0/82633189 shutdown_connections 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 -- 172.21.15.43:0/82633189 wait complete. 2024-04-25T20:49:19.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.022+0000 7fc6f1445700 1 Processor -- start 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 -- start start 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec103530 0x7fc6ec1a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec10d570 con 0x7fc6ec102b90 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec10d3f0 con 0x7fc6ec103530 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6f1445700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec10d6f0 con 0x7fc6ec101990 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49586/0 (socket says 172.21.15.43:49586) 2024-04-25T20:49:19.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 -- 172.21.15.43:0/1332130203 learned_addr learned my addr 172.21.15.43:0/1332130203 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6eb7fe700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec103530 0x7fc6ec1a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6eaffd700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 -- 172.21.15.43:0/1332130203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 msgr2=0x7fc6ec198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 -- 172.21.15.43:0/1332130203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec103530 msgr2=0x7fc6ec1a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec103530 0x7fc6ec1a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 -- 172.21.15.43:0/1332130203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec1a0840 con 0x7fc6ec102b90 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6eaffd700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.023+0000 7fc6ea7fc700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00c9e0 tx=0x7fc6dc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.024+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc007ac0 con 0x7fc6ec102b90 2024-04-25T20:49:19.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.024+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec1a0b30 con 0x7fc6ec102b90 2024-04-25T20:49:19.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.024+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6dc007c60 con 0x7fc6ec102b90 2024-04-25T20:49:19.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.024+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc018660 con 0x7fc6ec102b90 2024-04-25T20:49:19.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.024+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1a1070 con 0x7fc6ec102b90 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.025+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec069730 con 0x7fc6ec102b90 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.026+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fc6dc004870 con 0x7fc6ec102b90 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.026+0000 7fc6d3fff700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 0x7fc6d40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.027+0000 7fc6eaffd700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 0x7fc6d40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.027+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fc6dc0d0430 con 0x7fc6ec102b90 2024-04-25T20:49:19.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.027+0000 7fc6eaffd700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 0x7fc6d40a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0005fd0 tx=0x7fc6e0005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:19.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.031+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6dc014030 con 0x7fc6ec102b90 2024-04-25T20:49:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.249+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc6ec0fefd0 con 0x7fc6d40a3c40 2024-04-25T20:49:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.251+0000 7fc6d3fff700 1 -- 172.21.15.43:0/1332130203 <== mgr.14152 v2:172.21.15.43:6800/3531160359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc6ec0fefd0 con 0x7fc6d40a3c40 2024-04-25T20:49:19.251 INFO:teuthology.orchestra.run.smithi043.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T20:49:19.251 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GH480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-04-25T20:49:19.252 INFO:teuthology.orchestra.run.smithi043.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-25T20:49:19.252 INFO:teuthology.orchestra.run.smithi043.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 msgr2=0x7fc6d40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 0x7fc6d40a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0005fd0 tx=0x7fc6e0005f00 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 msgr2=0x7fc6ec199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00c9e0 tx=0x7fc6dc00ccf0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 shutdown_connections 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc6d40a3c40 0x7fc6d40a6100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6ec101990 0x7fc6ec198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6ec103530 0x7fc6ec1a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 --2- 172.21.15.43:0/1332130203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6ec102b90 0x7fc6ec199120 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 >> 172.21.15.43:0/1332130203 conn(0x7fc6ec0fcf30 msgr2=0x7fc6ec0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 shutdown_connections 2024-04-25T20:49:19.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:19.253+0000 7fc6f1445700 1 -- 172.21.15.43:0/1332130203 wait complete. 2024-04-25T20:49:19.982 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T20:49:19.991 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:49:19.991 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T20:49:20.243 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:19 smithi043 ceph-mon[29167]: pgmap v388: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:20.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:19 smithi043 ceph-mon[29167]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:20.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:19 smithi195 ceph-mon[33250]: pgmap v388: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:20.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:19 smithi195 ceph-mon[33250]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:20.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:19 smithi112 ceph-mon[32322]: pgmap v388: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:20.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:19 smithi112 ceph-mon[32322]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:49:21.972 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:21 smithi043 ceph-mon[29167]: pgmap v389: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 -- 172.21.15.43:0/3475844752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac781019a0 msgr2=0x7fac78101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3475844752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac781019a0 0x7fac78101dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0099c0 tx=0x7fac6c009cd0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 -- 172.21.15.43:0/3475844752 shutdown_connections 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3475844752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78103540 0x7fac78109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3475844752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac781019a0 0x7fac78101dc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3475844752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac78102ba0 0x7fac78103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 -- 172.21.15.43:0/3475844752 >> 172.21.15.43:0/3475844752 conn(0x7fac780fcf60 msgr2=0x7fac780ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 -- 172.21.15.43:0/3475844752 shutdown_connections 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.080+0000 7fac7eb77700 1 -- 172.21.15.43:0/3475844752 wait complete. 2024-04-25T20:49:22.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 Processor -- start 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 -- start start 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac781019a0 0x7fac78198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78102ba0 0x7fac781992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac7810e6c0 con 0x7fac78103540 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac7810e540 con 0x7fac78102ba0 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7eb77700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fac7810e840 con 0x7fac781019a0 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7d114700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7d114700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49598/0 (socket says 172.21.15.43:49598) 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7d114700 1 -- 172.21.15.43:0/3152633550 learned_addr learned my addr 172.21.15.43:0/3152633550 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac7c913700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac781019a0 0x7fac78198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:22.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.081+0000 7fac77fff700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78102ba0 0x7fac781992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 -- 172.21.15.43:0/3152633550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac781019a0 msgr2=0x7fac78198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac781019a0 0x7fac78198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 -- 172.21.15.43:0/3152633550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78102ba0 msgr2=0x7fac781992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78102ba0 0x7fac781992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 -- 172.21.15.43:0/3152633550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781a0960 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7d114700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fac70007ee0 tx=0x7fac7000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004bb0 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac70004d50 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781a0c50 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac700059e0 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.082+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781a1190 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.083+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac78069730 con 0x7fac78103540 2024-04-25T20:49:22.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.084+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fac7001a020 con 0x7fac78103540 2024-04-25T20:49:22.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.085+0000 7fac75ffb700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 0x7fac680a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:22.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.085+0000 7fac7c913700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 0x7fac680a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:22.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.085+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fac700cfa20 con 0x7fac78103540 2024-04-25T20:49:22.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.085+0000 7fac7c913700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 0x7fac680a6180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac7819a1f0 tx=0x7fac6c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:22.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.089+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fac70010070 con 0x7fac78103540 2024-04-25T20:49:22.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:21 smithi195 ceph-mon[33250]: pgmap v389: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:21 smithi112 ceph-mon[32322]: pgmap v389: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.344+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fac78063650 con 0x7fac78103540 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.344+0000 7fac75ffb700 1 -- 172.21.15.43:0/3152633550 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3094 (secure 0 0 0) 0x7fac7009c410 con 0x7fac78103540 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:e27 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:legacy client fscid: 1 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:Filesystem 'cephfs' (1) 2024-04-25T20:49:22.345 INFO:teuthology.orchestra.run.smithi043.stdout:fs_name cephfs 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 27 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T20:46:27.488319+0000 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-25T20:46:49.738625+0000 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:tableserver 0 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:root 0 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:session_timeout 300 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:session_autoclose 300 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:max_file_size 1099511627776 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:max_xattr_size 65536 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:required_client_features {} 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure 0 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:last_failure_osd_epoch 0 2024-04-25T20:49:22.346 INFO:teuthology.orchestra.run.smithi043.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:max_mds 5 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:in 0,1,2,3,4 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:up {0=24470,1=24449,2=24448,3=24430,4=24424} 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:failed 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:damaged 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:stopped 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:data_pools [3] 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:metadata_pool 2 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:inline_data disabled 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:balancer 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:bal_rank_mask -1 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:standby_count_wanted 0 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:qdb_cluster leader: 24470 members: 24424,24430,24448,24449,24470 2024-04-25T20:49:22.347 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b{0:24470} state up:active seq 6 addr [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.e{0:24422} state up:standby-replay seq 1 addr [v2:172.21.15.112:6834/1792854312,v1:172.21.15.112:6835/1792854312] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.h{1:24449} state up:active seq 12 addr [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.k{1:24404} state up:standby-replay seq 1 addr [v2:172.21.15.112:6832/2634876322,v1:172.21.15.112:6833/2634876322] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.i{2:24448} state up:active seq 12 addr [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.l{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.195:6832/2602577561,v1:172.21.15.195:6833/2602577561] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c{3:24430} state up:active seq 14 addr [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a{3:14568} state up:standby-replay seq 1 addr [v2:172.21.15.43:6840/2354201113,v1:172.21.15.43:6841/2354201113] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.f{4:24424} state up:active seq 15 addr [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.g{4:14556} state up:standby-replay seq 1 addr [v2:172.21.15.43:6838/283016818,v1:172.21.15.43:6839/283016818] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:Standby daemons: 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.j{-1:14496} state up:standby seq 1 addr [v2:172.21.15.43:6834/3741268210,v1:172.21.15.43:6835/3741268210] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.348 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d{-1:14502} state up:standby seq 1 addr [v2:172.21.15.43:6836/4072774695,v1:172.21.15.43:6837/4072774695] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T20:49:22.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 msgr2=0x7fac680a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:22.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 0x7fac680a6180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac7819a1f0 tx=0x7fac6c009f10 comp rx=0 tx=0).stop 2024-04-25T20:49:22.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 msgr2=0x7fac781a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fac70007ee0 tx=0x7fac7000d3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 shutdown_connections 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fac680a3cc0 0x7fac680a6180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac781019a0 0x7fac78198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac78103540 0x7fac781a0290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 --2- 172.21.15.43:0/3152633550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac78102ba0 0x7fac781992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 >> 172.21.15.43:0/3152633550 conn(0x7fac780fcf60 msgr2=0x7fac78105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 shutdown_connections 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:22.348+0000 7fac7eb77700 1 -- 172.21.15.43:0/3152633550 wait complete. 2024-04-25T20:49:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:49:23.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:22 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3152633550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T20:49:23.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-25T20:49:23.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:22 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3152633550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T20:49:23.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:22 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3152633550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T20:49:23.358 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:23 smithi043 ceph-mon[29167]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:23 smithi195 ceph-mon[33250]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:23 smithi112 ceph-mon[32322]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.173+0000 7f03a549c700 1 -- 172.21.15.43:0/4029630279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0104640 msgr2=0x7f03a010aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.173+0000 7f03a549c700 1 --2- 172.21.15.43:0/4029630279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0104640 0x7f03a010aef0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f039800b0d0 tx=0x7f039800b3e0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 -- 172.21.15.43:0/4029630279 shutdown_connections 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 --2- 172.21.15.43:0/4029630279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0102aa0 0x7f03a0102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 --2- 172.21.15.43:0/4029630279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0104640 0x7f03a010aef0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 --2- 172.21.15.43:0/4029630279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0103ca0 0x7f03a0104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 -- 172.21.15.43:0/4029630279 >> 172.21.15.43:0/4029630279 conn(0x7f03a00fe040 msgr2=0x7f03a0100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 -- 172.21.15.43:0/4029630279 shutdown_connections 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 -- 172.21.15.43:0/4029630279 wait complete. 2024-04-25T20:49:25.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 Processor -- start 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.174+0000 7f03a549c700 1 -- start start 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0102aa0 0x7f03a0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0103ca0 0x7f03a01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03a010e6d0 con 0x7f03a0103ca0 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03a010e550 con 0x7f03a0102aa0 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f03a549c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03a010e850 con 0x7f03a0104640 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0102aa0 0x7f03a0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:45964/0 (socket says 172.21.15.43:45964) 2024-04-25T20:49:25.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 -- 172.21.15.43:0/2723514676 learned_addr learned my addr 172.21.15.43:0/2723514676 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:25.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 -- 172.21.15.43:0/2723514676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0102aa0 msgr2=0x7f03a0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:25.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0102aa0 0x7f03a0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 -- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0103ca0 msgr2=0x7f03a01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0103ca0 0x7f03a01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.175+0000 7f039f7fe700 1 -- 172.21.15.43:0/2723514676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01a0900 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f039f7fe700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0398009cd0 tx=0x7f0398007dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398021020 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a01a0b90 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f039801d940 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0398005650 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.176+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a01a1040 con 0x7f03a0104640 2024-04-25T20:49:25.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.177+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a0069730 con 0x7f03a0104640 2024-04-25T20:49:25.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.179+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f0398024020 con 0x7f03a0104640 2024-04-25T20:49:25.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.180+0000 7f0387fff700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 0x7f03880a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:25.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.180+0000 7f039effd700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 0x7f03880a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:25.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.180+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f039800f020 con 0x7f03a0104640 2024-04-25T20:49:25.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.180+0000 7f039effd700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 0x7f03880a6180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0394005950 tx=0x7f03940058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:25.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.185+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f039802d2f0 con 0x7f03a0104640 2024-04-25T20:49:25.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.395+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f03a0063650 con 0x7f03a0104640 2024-04-25T20:49:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.396+0000 7f0387fff700 1 -- 172.21.15.43:0/2723514676 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5274 (secure 0 0 0) 0x7f039809ee20 con 0x7f03a0104640 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 91 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-25T20:37:59.861097+0000 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-25T20:47:05.741996+0000 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 26 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-04-25T20:49:25.398 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client luminous 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release squid 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 12 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6802/1217576324,v1:172.21.15.43:6803/1217576324] [v2:172.21.15.43:6804/1217576324,v1:172.21.15.43:6805/1217576324] exists,up f4c56ba7-7f1c-4efe-b163-b34e794c2af2 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 13 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/3348323695,v1:172.21.15.112:6801/3348323695] [v2:172.21.15.112:6802/3348323695,v1:172.21.15.112:6803/3348323695] exists,up 9d509437-4cc7-4b3c-aedd-d207aac56272 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/2000658150,v1:172.21.15.195:6801/2000658150] [v2:172.21.15.195:6802/2000658150,v1:172.21.15.195:6803/2000658150] exists,up a14b64b6-b983-417a-b55b-9c2c73ad97a8 2024-04-25T20:49:25.399 INFO:teuthology.orchestra.run.smithi043.stdout:osd.3 up in weight 1 up_from 26 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6810/3411063045,v1:172.21.15.43:6811/3411063045] [v2:172.21.15.43:6812/3411063045,v1:172.21.15.43:6813/3411063045] exists,up f20ea1a7-c87a-42fc-a98f-e7874e1560db 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.4 up in weight 1 up_from 34 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/429665117,v1:172.21.15.112:6809/429665117] [v2:172.21.15.112:6810/429665117,v1:172.21.15.112:6811/429665117] exists,up ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.5 up in weight 1 up_from 39 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6808/280629682,v1:172.21.15.195:6809/280629682] [v2:172.21.15.195:6810/280629682,v1:172.21.15.195:6811/280629682] exists,up 655a8020-e914-4eb9-8eb6-b00c7f1a68e3 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.6 up in weight 1 up_from 47 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6818/1789482351,v1:172.21.15.43:6819/1789482351] [v2:172.21.15.43:6820/1789482351,v1:172.21.15.43:6821/1789482351] exists,up 22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.7 up in weight 1 up_from 52 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/3123103723,v1:172.21.15.112:6817/3123103723] [v2:172.21.15.112:6818/3123103723,v1:172.21.15.112:6819/3123103723] exists,up c07c9491-642a-420f-b45d-5626b7539d34 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.8 up in weight 1 up_from 60 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6816/81594991,v1:172.21.15.195:6817/81594991] [v2:172.21.15.195:6818/81594991,v1:172.21.15.195:6819/81594991] exists,up 105fc845-edce-449f-884a-2fa640a599f7 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.9 up in weight 1 up_from 68 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.43:6826/309263897,v1:172.21.15.43:6827/309263897] [v2:172.21.15.43:6828/309263897,v1:172.21.15.43:6829/309263897] exists,up 00f53017-0b8d-48a7-90cb-2b42a124b861 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.10 up in weight 1 up_from 73 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/3019340064,v1:172.21.15.112:6825/3019340064] [v2:172.21.15.112:6826/3019340064,v1:172.21.15.112:6827/3019340064] exists,up fa850133-269d-405c-a1a2-64122432d80a 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:osd.11 up in weight 1 up_from 81 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6824/1436610024,v1:172.21.15.195:6825/1436610024] [v2:172.21.15.195:6826/1436610024,v1:172.21.15.195:6827/1436610024] exists,up 4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.8 [2,11] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 2.b [8,11] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.0 [5,9] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.1 [4,9] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.3 [4,9] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.1b [3,8] 2024-04-25T20:49:25.400 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.28 [5,6] 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:pg_upmap_items 3.3a [4,8] 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/1294774526 expires 2024-04-26T20:39:04.572932+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/1388340659 expires 2024-04-26T20:39:04.572932+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/1388340659 expires 2024-04-26T20:39:04.572932+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6800/2222849100 expires 2024-04-26T20:38:37.272305+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/2986666548 expires 2024-04-26T20:38:37.272305+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:6801/2222849100 expires 2024-04-26T20:38:37.272305+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/544130458 expires 2024-04-26T20:39:04.572932+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/3989115997 expires 2024-04-26T20:38:37.272305+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/4191607377 expires 2024-04-26T20:39:04.572932+0000 2024-04-25T20:49:25.401 INFO:teuthology.orchestra.run.smithi043.stdout:blocklist 172.21.15.43:0/2191695289 expires 2024-04-26T20:38:37.272305+0000 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 msgr2=0x7f03880a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 0x7f03880a6180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0394005950 tx=0x7f03940058e0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 msgr2=0x7f03a01a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0398009cd0 tx=0x7f0398007dc0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 shutdown_connections 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f03880a3cc0 0x7f03880a6180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03a0104640 0x7f03a01a0230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03a0102aa0 0x7f03a0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 --2- 172.21.15.43:0/2723514676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03a0103ca0 0x7f03a01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.399+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 >> 172.21.15.43:0/2723514676 conn(0x7f03a00fe040 msgr2=0x7f03a0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.400+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 shutdown_connections 2024-04-25T20:49:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:25.400+0000 7f03a549c700 1 -- 172.21.15.43:0/2723514676 wait complete. 2024-04-25T20:49:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:25 smithi043 ceph-mon[29167]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:25 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2723514676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T20:49:26.253 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-25T20:49:26.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:49:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:25 smithi195 ceph-mon[33250]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:26.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:25 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2723514676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T20:49:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:25 smithi112 ceph-mon[32322]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:25 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2723514676' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T20:49:26.522 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:28.219 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:27 smithi043 ceph-mon[29167]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:27 smithi195 ceph-mon[33250]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:27 smithi112 ceph-mon[32322]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:28.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 -- 172.21.15.43:0/3749478402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74108a70 msgr2=0x7fee74108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:28.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 --2- 172.21.15.43:0/3749478402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74108a70 0x7fee74108e50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009990 tx=0x7fee5c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 -- 172.21.15.43:0/3749478402 shutdown_connections 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 --2- 172.21.15.43:0/3749478402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74103480 0x7fee7410f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 --2- 172.21.15.43:0/3749478402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74108a70 0x7fee74108e50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 --2- 172.21.15.43:0/3749478402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74102ac0 0x7fee74102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 -- 172.21.15.43:0/3749478402 >> 172.21.15.43:0/3749478402 conn(0x7fee74079bb0 msgr2=0x7fee74079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 -- 172.21.15.43:0/3749478402 shutdown_connections 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.469+0000 7fee79759700 1 -- 172.21.15.43:0/3749478402 wait complete. 2024-04-25T20:49:28.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.470+0000 7fee79759700 1 Processor -- start 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.470+0000 7fee79759700 1 -- start start 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74102ac0 0x7fee7419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74108a70 0x7fee7419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fee74112d80 con 0x7fee74103480 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fee74112c00 con 0x7fee74108a70 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee79759700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fee74112f00 con 0x7fee74102ac0 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:28.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58588/0 (socket says 172.21.15.43:58588) 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 -- 172.21.15.43:0/4116389359 learned_addr learned my addr 172.21.15.43:0/4116389359 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee72ffd700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74102ac0 0x7fee7419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee737fe700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74108a70 0x7fee7419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 -- 172.21.15.43:0/4116389359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74102ac0 msgr2=0x7fee7419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74102ac0 0x7fee7419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 -- 172.21.15.43:0/4116389359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74108a70 msgr2=0x7fee7419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74108a70 0x7fee7419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 -- 172.21.15.43:0/4116389359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee741a04e0 con 0x7fee74103480 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.471+0000 7fee727fc700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d950 tx=0x7fee6400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.472+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64016070 con 0x7fee74103480 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.472+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee6400fd60 con 0x7fee74103480 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.472+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee741a07d0 con 0x7fee74103480 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.472+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6400e610 con 0x7fee74103480 2024-04-25T20:49:28.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.472+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee741a8050 con 0x7fee74103480 2024-04-25T20:49:28.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.473+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee74069730 con 0x7fee74103480 2024-04-25T20:49:28.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.474+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fee64019070 con 0x7fee74103480 2024-04-25T20:49:28.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.474+0000 7fee6bfff700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 0x7fee600a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:28.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.474+0000 7fee72ffd700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 0x7fee600a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.475+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fee640cfdc0 con 0x7fee74103480 2024-04-25T20:49:28.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.475+0000 7fee72ffd700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 0x7fee600a6180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00b5c0 tx=0x7fee5c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:28.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.478+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fee6409c7b0 con 0x7fee74103480 2024-04-25T20:49:28.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.732+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee7419c830 con 0x7fee74103480 2024-04-25T20:49:28.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.733+0000 7fee6bfff700 1 -- 172.21.15.43:0/4116389359 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7fee6409c0b0 con 0x7fee74103480 2024-04-25T20:49:28.735 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:28.735 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 msgr2=0x7fee600a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 0x7fee600a6180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00b5c0 tx=0x7fee5c005960 comp rx=0 tx=0).stop 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 msgr2=0x7fee7419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d950 tx=0x7fee6400dc60 comp rx=0 tx=0).stop 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 shutdown_connections 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fee600a3cc0 0x7fee600a6180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee74102ac0 0x7fee7419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fee74108a70 0x7fee7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 --2- 172.21.15.43:0/4116389359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee74103480 0x7fee7419ba10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:28.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 >> 172.21.15.43:0/4116389359 conn(0x7fee74079bb0 msgr2=0x7fee74074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:28.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 shutdown_connections 2024-04-25T20:49:28.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:28.735+0000 7fee79759700 1 -- 172.21.15.43:0/4116389359 wait complete. 2024-04-25T20:49:28.738 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:49:29.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:28 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4116389359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:29.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:28 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4116389359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:29.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:28 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4116389359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:29.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:49:29.857 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:30.264 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:29 smithi043 ceph-mon[29167]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:29 smithi195 ceph-mon[33250]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:29 smithi112 ceph-mon[32322]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.763+0000 7f0197ace700 1 -- 172.21.15.43:0/3310567836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 msgr2=0x7f0190102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.763+0000 7f0197ace700 1 --2- 172.21.15.43:0/3310567836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190102f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0180009990 tx=0x7f0180009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.763+0000 7f0197ace700 1 -- 172.21.15.43:0/3310567836 shutdown_connections 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 --2- 172.21.15.43:0/3310567836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 0x7f019010f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 --2- 172.21.15.43:0/3310567836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 0x7f0190108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 --2- 172.21.15.43:0/3310567836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190102f40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 -- 172.21.15.43:0/3310567836 >> 172.21.15.43:0/3310567836 conn(0x7f0190079bb0 msgr2=0x7f0190079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 -- 172.21.15.43:0/3310567836 shutdown_connections 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 -- 172.21.15.43:0/3310567836 wait complete. 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 Processor -- start 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.764+0000 7f0197ace700 1 -- start start 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 0x7f01901998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 0x7f019019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0190112e40 con 0x7f0190102ac0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0190112cc0 con 0x7f0190108a70 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0197ace700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0190112fc0 con 0x7f0190103480 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58606/0 (socket says 172.21.15.43:58606) 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 -- 172.21.15.43:0/1983482317 learned_addr learned my addr 172.21.15.43:0/1983482317 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019606b700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 0x7f019019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f0195069700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 0x7f01901998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 -- 172.21.15.43:0/1983482317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 msgr2=0x7f01901998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 0x7f01901998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 -- 172.21.15.43:0/1983482317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 msgr2=0x7f019019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 0x7f019019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 -- 172.21.15.43:0/1983482317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019019e3a0 con 0x7f0190102ac0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.765+0000 7f019586a700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b530 tx=0x7f018c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.766+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c015020 con 0x7f0190102ac0 2024-04-25T20:49:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.766+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f018c011d00 con 0x7f0190102ac0 2024-04-25T20:49:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.766+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c00f2e0 con 0x7f0190102ac0 2024-04-25T20:49:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.766+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019019e690 con 0x7f0190102ac0 2024-04-25T20:49:31.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.766+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01901a5f10 con 0x7f0190102ac0 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.767+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190069730 con 0x7f0190102ac0 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.768+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f018c018020 con 0x7f0190102ac0 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.769+0000 7f0186ffd700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 0x7f017c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.769+0000 7f0195069700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 0x7f017c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.769+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f018c0d0160 con 0x7f0190102ac0 2024-04-25T20:49:31.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.769+0000 7f0195069700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 0x7f017c0a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0180009750 tx=0x7f018000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:31.773+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f018c01f020 con 0x7f0190102ac0 2024-04-25T20:49:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.026+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f019002df80 con 0x7f0190102ac0 2024-04-25T20:49:32.028 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:31 smithi043 ceph-mon[29167]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:32.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.026+0000 7f0186ffd700 1 -- 172.21.15.43:0/1983482317 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11936 (secure 0 0 0) 0x7f018c09cb50 con 0x7f0190102ac0 2024-04-25T20:49:32.029 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:32.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:46:49.738625+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24424,24430,24448,24449,24470]},"id":1}]} 2024-04-25T20:49:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 msgr2=0x7f017c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 0x7f017c0a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0180009750 tx=0x7f018000b540 comp rx=0 tx=0).stop 2024-04-25T20:49:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 msgr2=0x7f0190199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b530 tx=0x7f018c00b840 comp rx=0 tx=0).stop 2024-04-25T20:49:32.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 shutdown_connections 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f017c0a3c40 0x7f017c0a6100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0190108a70 0x7f019019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0190102ac0 0x7f0190199390 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 --2- 172.21.15.43:0/1983482317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0190103480 0x7f01901998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 >> 172.21.15.43:0/1983482317 conn(0x7f0190079bb0 msgr2=0x7f0190101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 shutdown_connections 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:32.029+0000 7f0197ace700 1 -- 172.21.15.43:0/1983482317 wait complete. 2024-04-25T20:49:32.031 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 27 2024-04-25T20:49:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:31 smithi195 ceph-mon[33250]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:31 smithi112 ceph-mon[32322]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:32.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:49:32.991 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:33.248 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:32 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1983482317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:33.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:32 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1983482317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:33.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:32 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1983482317' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:49:34.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: pgmap v395: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:34.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:34.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.171 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.172 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:33 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: pgmap v395: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:33 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: pgmap v395: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:33 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 -- 172.21.15.43:0/3197611877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c108a60 msgr2=0x7f8b5c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 --2- 172.21.15.43:0/3197611877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c108a60 0x7f8b5c108e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009990 tx=0x7f8b58009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 -- 172.21.15.43:0/3197611877 shutdown_connections 2024-04-25T20:49:34.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 --2- 172.21.15.43:0/3197611877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b5c06bbb0 0x7f8b5c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 --2- 172.21.15.43:0/3197611877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c108a60 0x7f8b5c108e40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 --2- 172.21.15.43:0/3197611877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c06b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.730+0000 7f8b634b9700 1 -- 172.21.15.43:0/3197611877 >> 172.21.15.43:0/3197611877 conn(0x7f8b5c0789e0 msgr2=0x7f8b5c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.731+0000 7f8b634b9700 1 -- 172.21.15.43:0/3197611877 shutdown_connections 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.731+0000 7f8b634b9700 1 -- 172.21.15.43:0/3197611877 wait complete. 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.731+0000 7f8b634b9700 1 Processor -- start 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.731+0000 7f8b634b9700 1 -- start start 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b5c06bbb0 0x7f8b5c101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c108a60 0x7f8b5c102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112d80 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112c00 con 0x7f8b5c108a60 2024-04-25T20:49:34.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b634b9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c112f00 con 0x7f8b5c06bbb0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58624/0 (socket says 172.21.15.43:58624) 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 -- 172.21.15.43:0/662356962 learned_addr learned my addr 172.21.15.43:0/662356962 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61a56700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c108a60 0x7f8b5c102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 -- 172.21.15.43:0/662356962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b5c06bbb0 msgr2=0x7f8b5c101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b5c06bbb0 0x7f8b5c101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 -- 172.21.15.43:0/662356962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c108a60 msgr2=0x7f8b5c102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c108a60 0x7f8b5c102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 -- 172.21.15.43:0/662356962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c1a7780 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b61255700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000c00 tx=0x7f8b58009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.732+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58027070 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.733+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b58003fb0 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.733+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c1a7a10 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.733+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58022e10 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.733+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c1a7e60 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.733+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c10b060 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.735+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8b5802a070 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.735+0000 7f8b527fc700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 0x7f8b480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.736+0000 7f8b60a54700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 0x7f8b480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.736+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8b580d1610 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.736+0000 7f8b60a54700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 0x7f8b480a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:34.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.740+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8b58031070 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.952+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b5c02e020 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.954+0000 7f8b527fc700 1 -- 172.21.15.43:0/662356962 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22627 (secure 0 0 0) 0x7f8b58013070 con 0x7f8b5c06b1f0 2024-04-25T20:49:34.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:49:34.957 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":91,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:47:05.741996+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 msgr2=0x7f8b480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 0x7f8b480a6100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c005f60 comp rx=0 tx=0).stop 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 msgr2=0x7f8b5c1019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000c00 tx=0x7f8b58009f50 comp rx=0 tx=0).stop 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 shutdown_connections 2024-04-25T20:49:34.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8b480a3c40 0x7f8b480a6100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8b5c108a60 0x7f8b5c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5c06b1f0 0x7f8b5c1019b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 --2- 172.21.15.43:0/662356962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b5c06bbb0 0x7f8b5c101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 >> 172.21.15.43:0/662356962 conn(0x7f8b5c0789e0 msgr2=0x7f8b5c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.956+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 shutdown_connections 2024-04-25T20:49:34.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:34.957+0000 7f8b634b9700 1 -- 172.21.15.43:0/662356962 wait complete. 2024-04-25T20:49:35.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:34 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:49:35.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:34 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:49:35.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:34 smithi043 ceph-mon[29167]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:35.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:34 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:49:35.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:34 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:49:35.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:34 smithi195 ceph-mon[33250]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:35.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:34 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:49:35.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:34 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:49:35.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:34 smithi112 ceph-mon[32322]: from='mgr.14152 172.21.15.43:0/1535809564' entity='mgr.x' 2024-04-25T20:49:35.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T20:46:27.488319+0000', 'modified': '2024-04-25T20:46:49.738625+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24470, 'mds_1': 24449, 'mds_2': 24448, 'mds_3': 24430, 'mds_4': 24424}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14556': {'gid': 14556, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/283016818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 283016818}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 283016818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14568': {'gid': 14568, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6841/2354201113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 2354201113}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 2354201113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/2602577561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2602577561}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2602577561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6833/2634876322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 2634876322}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 2634876322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/1792854312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1792854312}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1792854312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.195:6835/1478210024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1478210024}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1478210024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.195:6837/97560283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 97560283}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 97560283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.195:6839/4260595708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 4260595708}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 4260595708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.112:6837/246583870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 246583870}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 246583870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.112:6839/2400080298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 2400080298}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 2400080298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24470, 'qdb_cluster': [24424, 24430, 24448, 24449, 24470]} 2024-04-25T20:49:35.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T20:49:35.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-25T20:49:35.923 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:36.226 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:35 smithi043 ceph-mon[29167]: pgmap v396: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:36.227 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/662356962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:49:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:35 smithi195 ceph-mon[33250]: pgmap v396: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:36.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/662356962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:49:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:35 smithi112 ceph-mon[32322]: pgmap v396: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/662356962' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3751902243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4102300 msgr2=0x7fe8e410e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3751902243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4102300 0x7fe8e410e7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b0a0 tx=0x7fe8dc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3751902243 shutdown_connections 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3751902243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4107990 0x7fe8e4107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3751902243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4102300 0x7fe8e410e7f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3751902243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4101940 0x7fe8e4101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3751902243 >> 172.21.15.43:0/3751902243 conn(0x7fe8e40788f0 msgr2=0x7fe8e4078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3751902243 shutdown_connections 2024-04-25T20:49:37.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.645+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3751902243 wait complete. 2024-04-25T20:49:37.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 Processor -- start 2024-04-25T20:49:37.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 -- start start 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4101940 0x7fe8e41034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4102300 0x7fe8e4103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4111c40 con 0x7fe8e4107990 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4111ac0 con 0x7fe8e4102300 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e8c30700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4111dc0 con 0x7fe8e4101940 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58380/0 (socket says 172.21.15.43:58380) 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3544259338 learned_addr learned my addr 172.21.15.43:0/3544259338 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.646+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4102300 0x7fe8e4103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4101940 0x7fe8e41034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3544259338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4101940 msgr2=0x7fe8e41034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4101940 0x7fe8e41034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3544259338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4102300 msgr2=0x7fe8e4103a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4102300 0x7fe8e4103a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3544259338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41a76e0 con 0x7fe8e4107990 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b070 tx=0x7fe8dc007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8d37fe700 1 -- 172.21.15.43:0/3544259338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc021070 con 0x7fe8e4107990 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8d37fe700 1 -- 172.21.15.43:0/3544259338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8dc01db20 con 0x7fe8e4107990 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e41a7970 con 0x7fe8e4107990 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8d37fe700 1 -- 172.21.15.43:0/3544259338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc01bb50 con 0x7fe8e4107990 2024-04-25T20:49:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.647+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41a7e20 con 0x7fe8e4107990 2024-04-25T20:49:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.650+0000 7fe8d37fe700 1 -- 172.21.15.43:0/3544259338 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fe8dc024070 con 0x7fe8e4107990 2024-04-25T20:49:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.650+0000 7fe8d37fe700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 0x7fe8cc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.650+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 0x7fe8cc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.650+0000 7fe8d37fe700 1 -- 172.21.15.43:0/3544259338 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe8dc00f020 con 0x7fe8e4107990 2024-04-25T20:49:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.651+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 0x7fe8cc0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4005fd0 tx=0x7fe8d4005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.651+0000 7fe8f34b9b80 1 Processor -- start 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.651+0000 7fe8f34b9b80 1 -- start start 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.651+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.651+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e2f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e2f880 0x563cf6e31c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563cf6d77c40 con 0x563cf6e240b0 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cf6d1e8e0 con 0x563cf6e249d0 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563cf6d73c00 con 0x563cf6e2f880 2024-04-25T20:49:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58390/0 (socket says 172.21.15.43:58390) 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 -- 172.21.15.43:0/433974513 learned_addr learned my addr 172.21.15.43:0/433974513 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e2f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e2f880 0x563cf6e31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 -- 172.21.15.43:0/433974513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e2f880 msgr2=0x563cf6e31c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e2f880 0x563cf6e31c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 -- 172.21.15.43:0/433974513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 msgr2=0x563cf6e2f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e2f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 -- 172.21.15.43:0/433974513 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf6ce26f0 con 0x563cf6e240b0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8e259c700 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400a340 tx=0x7fe8d400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ce4e8855d5539c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8d0ff9700 1 -- 172.21.15.43:0/433974513 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4021070 con 0x563cf6e240b0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8d0ff9700 1 -- 172.21.15.43:0/433974513 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8d4010ca0 con 0x563cf6e240b0 2024-04-25T20:49:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.652+0000 7fe8d0ff9700 1 -- 172.21.15.43:0/433974513 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400f620 con 0x563cf6e240b0 2024-04-25T20:49:37.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/433974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 msgr2=0x563cf6e24490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400a340 tx=0x7fe8d400af90 comp rx=0 tx=0).stop 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/433974513 shutdown_connections 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e2f880 0x563cf6e31c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e240b0 0x563cf6e24490 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/433974513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e2f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/433974513 >> 172.21.15.43:0/433974513 conn(0x563cf6d51840 msgr2=0x563cf6e20580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/433974513 shutdown_connections 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.653+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/433974513 wait complete. 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 -- start start 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 Processor -- start 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e2ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e2f880 0x563cf6e2c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e32370 con 0x563cf6e249d0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cf6d31560 con 0x563cf6e2f880 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e324f0 con 0x563cf6e240b0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8f34b9b80 10 client.0 _ll_register_callbacks cb 0x563cf6d108d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58392/0 (socket says 172.21.15.43:58392) 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e1d9b700 1 -- 172.21.15.43:0/4121772182 learned_addr learned my addr 172.21.15.43:0/4121772182 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e259c700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e2ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e2f880 0x563cf6e2c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e1d9b700 1 -- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 msgr2=0x563cf6e2ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.654+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e2ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8e1d9b700 1 -- 172.21.15.43:0/4121772182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e2f880 msgr2=0x563cf6e2c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e2f880 0x563cf6e2c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8e1d9b700 1 -- 172.21.15.43:0/4121772182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cf6cc5880 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800bb70 tx=0x7fe8d800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6a4169a033fcb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8003d00 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe8d8004830 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d4010ca0 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8d8004a50 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8f34b9b80 10 client.15069 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563cf6e3cbd0 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8d4010ca0 con 0x563cf6e249d0 2024-04-25T20:49:37.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.655+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe8d80114d0 con 0x563cf6e249d0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 10 client.15069 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 20 client.15069 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e3f1d0 0x563cf6e40640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 4 client.15069 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cf6d85430 con 0x563cf6e3f1d0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8e259c700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e3f1d0 0x563cf6e40640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8c9ffb700 10 client.15069 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.656+0000 7fe8e259c700 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e3f1d0 0x563cf6e40640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=96e183df83ade36a server_cookie=55e1cc305ec33636 in_seq=0 out_seq=0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/4121772182 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563cf6d85430 con 0x563cf6e3f1d0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8c9ffb700 10 client.15069 handle_command_reply: tid=0 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 client.15069 shutdown 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 msgr2=0x563cf6e2c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800bb70 tx=0x7fe8d800be80 comp rx=0 tx=0).stop 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 shutdown_connections 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e3f1d0 0x563cf6e40640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8c9ffb700 0 client.15069 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e2ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e2f880 0x563cf6e2c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/4121772182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e2c250 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.657+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 >> 172.21.15.43:0/4121772182 conn(0x563cf6d51840 msgr2=0x563cf6e201b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.658+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 shutdown_connections 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.658+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/4121772182 wait complete. 2024-04-25T20:49:37.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.658+0000 7fe8f34b9b80 20 client.15069 trim_cache size 0 max 16384 2024-04-25T20:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.678+0000 7fe8f34b9b80 1 Processor -- start 2024-04-25T20:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.678+0000 7fe8f34b9b80 1 -- start start 2024-04-25T20:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e3e980 con 0x563cf6d51840 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e3f050 con 0x563cf6e249d0 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e3f720 con 0x563cf6e240b0 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58396/0 (socket says 172.21.15.43:58396) 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 -- 172.21.15.43:0/2755171253 learned_addr learned my addr 172.21.15.43:0/2755171253 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 -- 172.21.15.43:0/2755171253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 msgr2=0x563cf6e205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 -- 172.21.15.43:0/2755171253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 msgr2=0x563cf6e272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 -- 172.21.15.43:0/2755171253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf6e2f420 con 0x563cf6d51840 2024-04-25T20:49:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:37.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:37.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8e259c700 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe8d401dd40 tx=0x7fe8d401dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d9c0a048879f3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.679+0000 7fe8cbfff700 1 -- 172.21.15.43:0/2755171253 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4014040 con 0x563cf6d51840 2024-04-25T20:49:37.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8cbfff700 1 -- 172.21.15.43:0/2755171253 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8d403a070 con 0x563cf6d51840 2024-04-25T20:49:37.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8cbfff700 1 -- 172.21.15.43:0/2755171253 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4021040 con 0x563cf6d51840 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/2755171253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 msgr2=0x563cf6e20060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe8d401dd40 tx=0x7fe8d401dcd0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/2755171253 shutdown_connections 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6e249d0 0x563cf6e272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6d51840 0x563cf6e20060 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/2755171253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/2755171253 >> 172.21.15.43:0/2755171253 conn(0x563cf6e2d140 msgr2=0x563cf6e2ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/2755171253 shutdown_connections 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.680+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/2755171253 wait complete. 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 -- start start 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 Processor -- start 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6d51840 0x563cf6e49ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e404c0 con 0x563cf6e249d0 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e3fdf0 con 0x563cf6d51840 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563cf6e40b90 con 0x563cf6e240b0 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8f34b9b80 10 client.0 _ll_register_callbacks cb 0x563cf6d108d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8e2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8e2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58408/0 (socket says 172.21.15.43:58408) 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3848132803 learned_addr learned my addr 172.21.15.43:0/3848132803 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8e1d9b700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.681+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6d51840 0x563cf6e49ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 msgr2=0x563cf6e4a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e4a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3848132803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6d51840 msgr2=0x563cf6e49ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6d51840 0x563cf6e49ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 -- 172.21.15.43:0/3848132803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cf6e432e0 con 0x563cf6e249d0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8e2d9d700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cf500 tx=0x7fe8dc00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a42018afde0486b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0a20d0 con 0x563cf6e249d0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe8dc09c020 con 0x563cf6e249d0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d403a070 con 0x563cf6e249d0 2024-04-25T20:49:37.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc0a6900 con 0x563cf6e249d0 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8f34b9b80 10 client.15075 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.682+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563cf6ea6e80 con 0x563cf6e249d0 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe8d403a070 con 0x563cf6e249d0 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe8dc011070 con 0x563cf6e249d0 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 10 client.15075 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 10 client.15075 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 20 client.15075 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e2f880 0x563cf6eaa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 4 client.15075 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "status"}) -- 0x563cf6d7f4d0 con 0x563cf6e2f880 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e2f880 0x563cf6eaa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8c9ffb700 10 client.15075 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:49:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.683+0000 7fe8e259c700 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e2f880 0x563cf6eaa730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13e4fcfbeda66ae7 server_cookie=ea961ab89f13e598 in_seq=0 out_seq=0 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8c9ffb700 1 -- 172.21.15.43:0/3848132803 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563cf6d7f4d0 con 0x563cf6e2f880 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8c9ffb700 10 client.15075 handle_command_reply: tid=0 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 client.15075 shutdown 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 msgr2=0x563cf6e42aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0cf500 tx=0x7fe8dc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 shutdown_connections 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x563cf6e2f880 0x563cf6eaa730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563cf6e249d0 0x563cf6e42aa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563cf6d51840 0x563cf6e49ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 --2- 172.21.15.43:0/3848132803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563cf6e240b0 0x563cf6e4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 >> 172.21.15.43:0/3848132803 conn(0x563cf6e2d140 msgr2=0x563cf6e272c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8c9ffb700 0 client.15075 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 shutdown_connections 2024-04-25T20:49:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 1 -- 172.21.15.43:0/3848132803 wait complete. 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.684+0000 7fe8f34b9b80 20 client.15075 trim_cache size 0 max 16384 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 4, 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24424, 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 172.19197665999999, 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:37.691 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 224.96384714499999 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 msgr2=0x7fe8cc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 0x7fe8cc0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4005fd0 tx=0x7fe8d4005d90 comp rx=0 tx=0).stop 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 msgr2=0x7fe8e4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b070 tx=0x7fe8dc007a20 comp rx=0 tx=0).stop 2024-04-25T20:49:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 shutdown_connections 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe8cc0a3c40 0x7fe8cc0a6100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8e4101940 0x7fe8e41034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8e4107990 0x7fe8e4103f70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 --2- 172.21.15.43:0/3544259338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe8e4102300 0x7fe8e4103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 >> 172.21.15.43:0/3544259338 conn(0x7fe8e40788f0 msgr2=0x7fe8e406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 shutdown_connections 2024-04-25T20:49:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:37.685+0000 7fe8e8c30700 1 -- 172.21.15.43:0/3544259338 wait complete. 2024-04-25T20:49:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:37 smithi043 ceph-mon[29167]: pgmap v397: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:38.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:37 smithi195 ceph-mon[33250]: pgmap v397: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:37 smithi112 ceph-mon[32322]: pgmap v397: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:38.390 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-25T20:49:38.644 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:40.178 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:39 smithi043 ceph-mon[29167]: pgmap v398: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:39 smithi195 ceph-mon[33250]: pgmap v398: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:39 smithi112 ceph-mon[32322]: pgmap v398: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:40.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 -- 172.21.15.43:0/2774071747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 msgr2=0x7f8e1c10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 --2- 172.21.15.43:0/2774071747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c10e830 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400b0a0 tx=0x7f8e1400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 -- 172.21.15.43:0/2774071747 shutdown_connections 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 --2- 172.21.15.43:0/2774071747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c10e830 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 --2- 172.21.15.43:0/2774071747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 0x7f8e1c107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 --2- 172.21.15.43:0/2774071747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 -- 172.21.15.43:0/2774071747 >> 172.21.15.43:0/2774071747 conn(0x7f8e1c0789e0 msgr2=0x7f8e1c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 -- 172.21.15.43:0/2774071747 shutdown_connections 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.427+0000 7f8e2133e700 1 -- 172.21.15.43:0/2774071747 wait complete. 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 Processor -- start 2024-04-25T20:49:40.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 -- start start 2024-04-25T20:49:40.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 0x7f8e1c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c111d90 con 0x7f8e1c102320 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c111c10 con 0x7f8e1c107960 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.428+0000 7f8e2133e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c111f10 con 0x7f8e1c101960 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58418/0 (socket says 172.21.15.43:58418) 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3972831587 learned_addr learned my addr 172.21.15.43:0/3972831587 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1b7fe700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 0x7f8e1c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3972831587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 msgr2=0x7f8e1c19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3972831587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 msgr2=0x7f8e1c1a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 0x7f8e1c1a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3972831587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c1a5750 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b530 tx=0x7f8e1000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e03fff700 1 -- 172.21.15.43:0/3972831587 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10015020 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c197fe0 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e03fff700 1 -- 172.21.15.43:0/3972831587 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e10011d00 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.429+0000 7f8e03fff700 1 -- 172.21.15.43:0/3972831587 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10010e60 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.430+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c198520 con 0x7f8e1c102320 2024-04-25T20:49:40.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.432+0000 7f8e03fff700 1 -- 172.21.15.43:0/3972831587 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8e10018020 con 0x7f8e1c102320 2024-04-25T20:49:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.432+0000 7f8e03fff700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 0x7f8e040a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.433+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 0x7f8e040a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.433+0000 7f8e03fff700 1 -- 172.21.15.43:0/3972831587 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8e100cfca0 con 0x7f8e1c102320 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.433+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 0x7f8e040a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0099d0 tx=0x7f8e0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.433+0000 7f8e2bbc7b80 1 Processor -- start 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.433+0000 7f8e2bbc7b80 1 -- start start 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7688bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a768d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0a75dace0 con 0x55d0a76890f0 2024-04-25T20:49:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d0a7581910 con 0x55d0a768d580 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d0a75d6ca0 con 0x55d0a76887d0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58424/0 (socket says 172.21.15.43:58424) 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3613692322 learned_addr learned my addr 172.21.15.43:0/3613692322 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1b7fe700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a768d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7688bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3613692322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 msgr2=0x55d0a7688bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7688bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3613692322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 msgr2=0x55d0a768d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a768d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3613692322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a7528880 con 0x55d0a76890f0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7688bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8e10098900 tx=0x7f8e10010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea67fbd1f7ef0348 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e017fa700 1 -- 172.21.15.43:0/3613692322 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1009bf30 con 0x55d0a76890f0 2024-04-25T20:49:40.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e017fa700 1 -- 172.21.15.43:0/3613692322 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e100a02e0 con 0x55d0a76890f0 2024-04-25T20:49:40.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.434+0000 7f8e017fa700 1 -- 172.21.15.43:0/3613692322 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e100a4710 con 0x55d0a76890f0 2024-04-25T20:49:40.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3613692322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 msgr2=0x55d0a768d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8e10098900 tx=0x7f8e10010900 comp rx=0 tx=0).stop 2024-04-25T20:49:40.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3613692322 shutdown_connections 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7688bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a768d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3613692322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a768d040 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3613692322 >> 172.21.15.43:0/3613692322 conn(0x55d0a75b5640 msgr2=0x55d0a7683820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3613692322 shutdown_connections 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.435+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3613692322 wait complete. 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 -- start start 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 Processor -- start 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a76887d0 0x55d0a7694b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a768d580 0x55d0a7692340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0a7695610 con 0x55d0a76890f0 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d0a7579b80 con 0x55d0a76887d0 2024-04-25T20:49:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d0a7695790 con 0x55d0a768d580 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e2bbc7b80 10 client.0 _ll_register_callbacks cb 0x55d0a7573900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58430/0 (socket says 172.21.15.43:58430) 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/2649318756 learned_addr learned my addr 172.21.15.43:0/2649318756 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e1affd700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a76887d0 0x55d0a7694b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.436+0000 7f8e1b7fe700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a768d580 0x55d0a7692340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a768d580 msgr2=0x55d0a7692340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a768d580 0x55d0a7692340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/2649318756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a76887d0 msgr2=0x55d0a7694b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a76887d0 0x55d0a7694b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/2649318756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a7592220 con 0x55d0a76890f0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8e1009c590 tx=0x7f8e1000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a128ff8090ae8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10099fd0 con 0x55d0a76890f0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8e100b5240 con 0x55d0a76890f0 2024-04-25T20:49:40.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e100a02e0 con 0x55d0a76890f0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e1009bf30 con 0x55d0a76890f0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e2bbc7b80 10 client.15087 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0a7695610 con 0x55d0a76890f0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e100a02e0 con 0x55d0a76890f0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.437+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8e1009b380 con 0x55d0a76890f0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 10 client.15087 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 20 client.15087 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a76a1f60 0x55d0a76a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 4 client.15087 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0a75e84d0 con 0x55d0a76a1f60 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e1affd700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a76a1f60 0x55d0a76a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8e1affd700 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a76a1f60 0x55d0a76a33d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b4aca33b11712692 server_cookie=ca391a642d062cd3 in_seq=0 out_seq=0 2024-04-25T20:49:40.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.438+0000 7f8dfeff5700 10 client.15087 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8dfeff5700 1 -- 172.21.15.43:0/2649318756 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0a75e84d0 con 0x55d0a76a1f60 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8dfeff5700 10 client.15087 handle_command_reply: tid=0 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 client.15087 shutdown 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 msgr2=0x55d0a7691e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8e1009c590 tx=0x7f8e1000bf10 comp rx=0 tx=0).stop 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 shutdown_connections 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a76a1f60 0x55d0a76a33d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a768d580 0x55d0a7692340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a76887d0 0x55d0a7694b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/2649318756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7691e00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8dfeff5700 0 client.15087 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 >> 172.21.15.43:0/2649318756 conn(0x55d0a75b5640 msgr2=0x55d0a768e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 shutdown_connections 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.439+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/2649318756 wait complete. 2024-04-25T20:49:40.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.440+0000 7f8e2bbc7b80 20 client.15087 trim_cache size 0 max 16384 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 Processor -- start 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 -- start start 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7691100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a7693b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a1710 con 0x55d0a76890f0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a1de0 con 0x55d0a768d580 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a24b0 con 0x55d0a76887d0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58438/0 (socket says 172.21.15.43:58438) 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/1532259603 learned_addr learned my addr 172.21.15.43:0/1532259603 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/1532259603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 msgr2=0x55d0a7691100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7691100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/1532259603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 msgr2=0x55d0a7693b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a7693b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.460+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/1532259603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a76a4330 con 0x55d0a76890f0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b500 tx=0x7f8e10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b0419a9488d763 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e00ff9700 1 -- 172.21.15.43:0/1532259603 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e100a02e0 con 0x55d0a76890f0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e00ff9700 1 -- 172.21.15.43:0/1532259603 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e10080070 con 0x55d0a76890f0 2024-04-25T20:49:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e00ff9700 1 -- 172.21.15.43:0/1532259603 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e100a4970 con 0x55d0a76890f0 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/1532259603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 msgr2=0x55d0a7693630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b500 tx=0x7f8e10004750 comp rx=0 tx=0).stop 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/1532259603 shutdown_connections 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a7691100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a7693b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/1532259603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a7693630 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/1532259603 >> 172.21.15.43:0/1532259603 conn(0x55d0a75b5640 msgr2=0x55d0a7687e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/1532259603 shutdown_connections 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.461+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/1532259603 wait complete. 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 -- start start 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 Processor -- start 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a76a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a76a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a3250 con 0x55d0a76890f0 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a2b80 con 0x55d0a768d580 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d0a76a3920 con 0x55d0a76887d0 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e2bbc7b80 10 client.0 _ll_register_callbacks cb 0x55d0a7573900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58452/0 (socket says 172.21.15.43:58452) 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3649842075 learned_addr learned my addr 172.21.15.43:0/3649842075 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1b7fe700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a76a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a76a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 msgr2=0x55d0a76a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a76a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3649842075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 msgr2=0x55d0a76a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a76a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.462+0000 7f8e1a7fc700 1 -- 172.21.15.43:0/3649842075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a76aacd0 con 0x55d0a76890f0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e1a7fc700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e10098900 tx=0x7f8e1000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c964aa52bcca48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10085390 con 0x55d0a76890f0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f8e100b5230 con 0x55d0a76890f0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e10080070 con 0x55d0a76890f0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e100b5430 con 0x55d0a76890f0 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 10 client.15093 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0a76aacd0 con 0x55d0a76890f0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e10080070 con 0x55d0a76890f0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f8e1009adf0 con 0x55d0a76890f0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 10 client.15093 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 20 client.15093 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a770d840 0x55d0a770c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 4 client.15093 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.463+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "status"}) -- 0x55d0a75e2570 con 0x55d0a770d840 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a770d840 0x55d0a770c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8dfeff5700 10 client.15093 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e1affd700 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a770d840 0x55d0a770c550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fe92719b067b40b7 server_cookie=6201f18553288c38 in_seq=0 out_seq=0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8dfeff5700 1 -- 172.21.15.43:0/3649842075 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d0a75e2570 con 0x55d0a770d840 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8dfeff5700 10 client.15093 handle_command_reply: tid=0 2024-04-25T20:49:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 client.15093 shutdown 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 msgr2=0x55d0a76a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e10098900 tx=0x7f8e1000bf50 comp rx=0 tx=0).stop 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 shutdown_connections 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55d0a770d840 0x55d0a770c550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d0a76887d0 0x55d0a76a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d0a768d580 0x55d0a76a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8dfeff5700 0 client.15093 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 --2- 172.21.15.43:0/3649842075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0a76890f0 0x55d0a76a68e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.464+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 >> 172.21.15.43:0/3649842075 conn(0x55d0a75b5640 msgr2=0x55d0a7693630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 shutdown_connections 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2bbc7b80 1 -- 172.21.15.43:0/3649842075 wait complete. 2024-04-25T20:49:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2bbc7b80 20 client.15093 trim_cache size 0 max 16384 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 3, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24430, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 175.98699905999999, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 224.93868306100001 2024-04-25T20:49:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 msgr2=0x7f8e040a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 0x7f8e040a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0099d0 tx=0x7f8e0c008040 comp rx=0 tx=0).stop 2024-04-25T20:49:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 msgr2=0x7f8e1c19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b530 tx=0x7f8e1000b8f0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 shutdown_connections 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f8e040a3c40 0x7f8e040a6100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e1c101960 0x7f8e1c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e1c107960 0x7f8e1c1a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 --2- 172.21.15.43:0/3972831587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e1c102320 0x7f8e1c19a6d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 >> 172.21.15.43:0/3972831587 conn(0x7f8e1c0789e0 msgr2=0x7f8e1c104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 shutdown_connections 2024-04-25T20:49:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:40.465+0000 7f8e2133e700 1 -- 172.21.15.43:0/3972831587 wait complete. 2024-04-25T20:49:41.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-25T20:49:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:41 smithi043 ceph-mon[29167]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:41 smithi195 ceph-mon[33250]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:41 smithi112 ceph-mon[32322]: pgmap v399: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 -- 172.21.15.43:0/1567125769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb258108a30 msgr2=0x7fb258108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/1567125769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb258108a30 0x7fb258108e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009990 tx=0x7fb24c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 -- 172.21.15.43:0/1567125769 shutdown_connections 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/1567125769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25806b0f0 0x7fb25810f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/1567125769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb258108a30 0x7fb258108e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/1567125769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806a750 0x7fb25806abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 -- 172.21.15.43:0/1567125769 >> 172.21.15.43:0/1567125769 conn(0x7fb2580788f0 msgr2=0x7fb258078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 -- 172.21.15.43:0/1567125769 shutdown_connections 2024-04-25T20:49:43.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.248+0000 7fb25f1b5700 1 -- 172.21.15.43:0/1567125769 wait complete. 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 Processor -- start 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 -- start start 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806b0f0 0x7fb258199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb258108a30 0x7fb25819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb258112d50 con 0x7fb25806a750 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb258112bd0 con 0x7fb25806b0f0 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25f1b5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb258112ed0 con 0x7fb258108a30 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58472/0 (socket says 172.21.15.43:58472) 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25cf51700 1 -- 172.21.15.43:0/57788150 learned_addr learned my addr 172.21.15.43:0/57788150 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.249+0000 7fb25d752700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb258108a30 0x7fb25819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb257fff700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806b0f0 0x7fb258199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 -- 172.21.15.43:0/57788150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb258108a30 msgr2=0x7fb25819da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb258108a30 0x7fb25819da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 -- 172.21.15.43:0/57788150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806b0f0 msgr2=0x7fb258199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806b0f0 0x7fb258199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 -- 172.21.15.43:0/57788150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25819e1a0 con 0x7fb25806a750 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25cf51700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000c00 tx=0x7fb24c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb255ffb700 1 -- 172.21.15.43:0/57788150 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c027070 con 0x7fb25806a750 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25819e430 con 0x7fb25806a750 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb255ffb700 1 -- 172.21.15.43:0/57788150 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb24c003fb0 con 0x7fb25806a750 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb255ffb700 1 -- 172.21.15.43:0/57788150 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c022e10 con 0x7fb25806a750 2024-04-25T20:49:43.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.250+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2581a5d10 con 0x7fb25806a750 2024-04-25T20:49:43.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.253+0000 7fb255ffb700 1 -- 172.21.15.43:0/57788150 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb24c02a070 con 0x7fb25806a750 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb255ffb700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 0x7fb2480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb257fff700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 0x7fb2480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb255ffb700 1 -- 172.21.15.43:0/57788150 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb24c0d0f60 con 0x7fb25806a750 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb269a3eb80 1 Processor -- start 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb269a3eb80 1 -- start start 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.254+0000 7fb257fff700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 0x7fb2480a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb258078f60 tx=0x7fb24400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225e9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf2253cc40 con 0x55cf225f8c90 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cf224e38e0 con 0x55cf225e99d0 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55cf22538c00 con 0x55cf225e90b0 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58486/0 (socket says 172.21.15.43:58486) 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 -- 172.21.15.43:0/2147778093 learned_addr learned my addr 172.21.15.43:0/2147778093 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25cf51700 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb257fff700 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 -- 172.21.15.43:0/2147778093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 msgr2=0x55cf225e9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225e9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 -- 172.21.15.43:0/2147778093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 msgr2=0x55cf225f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 -- 172.21.15.43:0/2147778093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf224a76f0 con 0x55cf225f8c90 2024-04-25T20:49:43.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb25d752700 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb250003fa0 tx=0x7fb250009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c230ebd538b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.255+0000 7fb242ffd700 1 -- 172.21.15.43:0/2147778093 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250004bb0 con 0x55cf225f8c90 2024-04-25T20:49:43.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb242ffd700 1 -- 172.21.15.43:0/2147778093 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2500048c0 con 0x55cf225f8c90 2024-04-25T20:49:43.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb242ffd700 1 -- 172.21.15.43:0/2147778093 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250007da0 con 0x55cf225f8c90 2024-04-25T20:49:43.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2147778093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 msgr2=0x55cf225fb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb250003fa0 tx=0x7fb250009ba0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2147778093 shutdown_connections 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225e9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf225fb080 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2147778093 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2147778093 >> 172.21.15.43:0/2147778093 conn(0x55cf22516840 msgr2=0x55cf225e5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2147778093 shutdown_connections 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.256+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2147778093 wait complete. 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 -- start start 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 Processor -- start 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e99d0 0x55cf225f5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf225f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf225fb780 con 0x55cf225e90b0 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cf224f6560 con 0x55cf225f8c90 2024-04-25T20:49:43.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55cf225fb900 con 0x55cf225e99d0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb269a3eb80 10 client.0 _ll_register_callbacks cb 0x55cf224d58d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58488/0 (socket says 172.21.15.43:58488) 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb25cf51700 1 -- 172.21.15.43:0/3121342566 learned_addr learned my addr 172.21.15.43:0/3121342566 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb25d752700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf225f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.257+0000 7fb257fff700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e99d0 0x55cf225f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 -- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e99d0 msgr2=0x55cf225f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e99d0 0x55cf225f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 -- 172.21.15.43:0/3121342566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 msgr2=0x55cf225f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf225f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 -- 172.21.15.43:0/3121342566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf2248a880 con 0x55cf225e90b0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25d752700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf225f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb25cf51700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0cea70 tx=0x7fb24c0228a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77685a076a3d9f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb237fff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c09d860 con 0x55cf225e90b0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb24c0a5b50 con 0x55cf225e90b0 2024-04-25T20:49:43.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2500048c0 con 0x55cf225e90b0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb24c0095c0 con 0x55cf225e90b0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb269a3eb80 10 client.15105 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cf22605fb0 con 0x55cf225e90b0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.258+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2500048c0 con 0x55cf225e90b0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb24c003ae0 con 0x55cf225e90b0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 20 client.15105 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22608720 0x55cf22609b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 4 client.15105 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf2254a430 con 0x55cf22608720 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb257fff700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22608720 0x55cf22609b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb237fff700 10 client.15105 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.259+0000 7fb257fff700 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22608720 0x55cf22609b90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=223c98eee7c7289 server_cookie=b7e06932fcb64b8b in_seq=0 out_seq=0 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb237fff700 1 -- 172.21.15.43:0/3121342566 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf2254a430 con 0x55cf22608720 2024-04-25T20:49:43.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb237fff700 10 client.15105 handle_command_reply: tid=0 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 client.15105 shutdown 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 msgr2=0x55cf225f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0cea70 tx=0x7fb24c0228a0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 shutdown_connections 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22608720 0x55cf22609b90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf225f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e90b0 0x55cf225f8350 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/3121342566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e99d0 0x55cf225f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 >> 172.21.15.43:0/3121342566 conn(0x55cf22516840 msgr2=0x55cf225e51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.260+0000 7fb237fff700 0 client.15105 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.261+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 shutdown_connections 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.261+0000 7fb269a3eb80 1 -- 172.21.15.43:0/3121342566 wait complete. 2024-04-25T20:49:43.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.261+0000 7fb269a3eb80 20 client.15105 trim_cache size 0 max 16384 2024-04-25T20:49:43.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 Processor -- start 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 -- start start 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf22612ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf22607ed0 con 0x55cf225e99d0 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cf226085a0 con 0x55cf225f8c90 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.281+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55cf22608c70 con 0x55cf225e90b0 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58492/0 (socket says 172.21.15.43:58492) 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 -- 172.21.15.43:0/2617050693 learned_addr learned my addr 172.21.15.43:0/2617050693 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb25d752700 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf22612ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb25cf51700 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 -- 172.21.15.43:0/2617050693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 msgr2=0x55cf225f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 -- 172.21.15.43:0/2617050693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 msgr2=0x55cf22612ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf22612ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 -- 172.21.15.43:0/2617050693 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf225f3bc0 con 0x55cf225e99d0 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb257fff700 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb244005d90 tx=0x7fb244013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f6e2781744b139 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb2427fc700 1 -- 172.21.15.43:0/2617050693 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244020bc0 con 0x55cf225e99d0 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb2427fc700 1 -- 172.21.15.43:0/2617050693 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb24402d070 con 0x55cf225e99d0 2024-04-25T20:49:43.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.282+0000 7fb2427fc700 1 -- 172.21.15.43:0/2617050693 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244011440 con 0x55cf225e99d0 2024-04-25T20:49:43.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2617050693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 msgr2=0x55cf225f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb244005d90 tx=0x7fb244013000 comp rx=0 tx=0).stop 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2617050693 shutdown_connections 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225f8c90 0x55cf22612ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/2617050693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225e99d0 0x55cf225f5b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2617050693 >> 172.21.15.43:0/2617050693 conn(0x55cf22516840 msgr2=0x55cf225f4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2617050693 shutdown_connections 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- 172.21.15.43:0/2617050693 wait complete. 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 -- start start 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.283+0000 7fb269a3eb80 1 Processor -- start 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf22612000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cf22609a10 con 0x55cf225f8c90 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cf22609340 con 0x55cf225e99d0 2024-04-25T20:49:43.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55cf2260a0e0 con 0x55cf225e90b0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb269a3eb80 10 client.0 _ll_register_callbacks cb 0x55cf224d58d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25d752700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf22612000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:37396/0 (socket says 172.21.15.43:37396) 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 -- 172.21.15.43:0/1612588757 learned_addr learned my addr 172.21.15.43:0/1612588757 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb257fff700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 -- 172.21.15.43:0/1612588757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 msgr2=0x55cf225f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 -- 172.21.15.43:0/1612588757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 msgr2=0x55cf22612000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf22612000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 -- 172.21.15.43:0/1612588757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf22612540 con 0x55cf225e90b0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25d752700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf22612000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb25cf51700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0cede0 tx=0x7fb24c09ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4941479794ade0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:43.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.284+0000 7fb237fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c082070 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24402d070 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb24c09c850 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb24c09db00 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 10 client.24814 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cf22613800 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb24402d070 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb24c0aa020 con 0x55cf225e90b0 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 10 client.24814 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 10 client.24814 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 20 client.24814 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22674000 0x55cf22672d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 4 client.24814 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.285+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "status"}) -- 0x55cf225444d0 con 0x55cf22674000 2024-04-25T20:49:43.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb257fff700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22674000 0x55cf22672d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb257fff700 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22674000 0x55cf22672d10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=856c3564f09c7299 server_cookie=c52b4da6a744005d in_seq=0 out_seq=0 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb237fff700 10 client.24814 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb237fff700 1 -- 172.21.15.43:0/1612588757 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cf225444d0 con 0x55cf22674000 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb237fff700 10 client.24814 handle_command_reply: tid=0 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb269a3eb80 1 client.24814 shutdown 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 msgr2=0x55cf225f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0cede0 tx=0x7fb24c09ce20 comp rx=0 tx=0).stop 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 shutdown_connections 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.286+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x55cf22674000 0x55cf22672d10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf225e90b0 0x55cf225f20c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cf225f8c90 0x55cf22612000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb237fff700 0 client.24814 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 --2- 172.21.15.43:0/1612588757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cf225e99d0 0x55cf225f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 >> 172.21.15.43:0/1612588757 conn(0x55cf22516840 msgr2=0x55cf22607300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 shutdown_connections 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 1 -- 172.21.15.43:0/1612588757 wait complete. 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb269a3eb80 20 client.24814 trim_cache size 0 max 16384 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24448, 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 179.81359148999999, 2024-04-25T20:49:43.293 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 221.73868201499999 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 msgr2=0x7fb2480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 0x7fb2480a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb258078f60 tx=0x7fb24400b410 comp rx=0 tx=0).stop 2024-04-25T20:49:43.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 msgr2=0x7fb2581991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000c00 tx=0x7fb24c009f50 comp rx=0 tx=0).stop 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 shutdown_connections 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb2480a3c40 0x7fb2480a6100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb258108a30 0x7fb25819da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb25806a750 0x7fb2581991e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 --2- 172.21.15.43:0/57788150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb25806b0f0 0x7fb258199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 >> 172.21.15.43:0/57788150 conn(0x7fb2580788f0 msgr2=0x7fb2580ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.287+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 shutdown_connections 2024-04-25T20:49:43.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:43.288+0000 7fb25f1b5700 1 -- 172.21.15.43:0/57788150 wait complete. 2024-04-25T20:49:44.027 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:43 smithi043 ceph-mon[29167]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:44.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-25T20:49:44.312 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:43 smithi195 ceph-mon[33250]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:43 smithi112 ceph-mon[32322]: pgmap v400: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-25T20:49:46.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 -- 172.21.15.43:0/2636205413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 msgr2=0x7f226c06b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 --2- 172.21.15.43:0/2636205413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c06b670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2260009990 tx=0x7f2260009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 -- 172.21.15.43:0/2636205413 shutdown_connections 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 --2- 172.21.15.43:0/2636205413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c108a60 0x7f226c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 --2- 172.21.15.43:0/2636205413 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c06bbb0 0x7f226c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 --2- 172.21.15.43:0/2636205413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c06b670 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 -- 172.21.15.43:0/2636205413 >> 172.21.15.43:0/2636205413 conn(0x7f226c0789e0 msgr2=0x7f226c078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 -- 172.21.15.43:0/2636205413 shutdown_connections 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.052+0000 7f2273035700 1 -- 172.21.15.43:0/2636205413 wait complete. 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.053+0000 7f2273035700 1 Processor -- start 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.053+0000 7f2273035700 1 -- start start 2024-04-25T20:49:46.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 0x7f226c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c108a60 0x7f226c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f226c112e10 con 0x7f226c06b1f0 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f226c112c90 con 0x7f226c108a60 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f226c112f90 con 0x7f226c06bbb0 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58868/0 (socket says 172.21.15.43:58868) 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 -- 172.21.15.43:0/2422524345 learned_addr learned my addr 172.21.15.43:0/2422524345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f226bfff700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 0x7f226c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f22715d2700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c108a60 0x7f226c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 -- 172.21.15.43:0/2422524345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 msgr2=0x7f226c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 0x7f226c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 -- 172.21.15.43:0/2422524345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c108a60 msgr2=0x7f226c19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c108a60 0x7f226c19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 -- 172.21.15.43:0/2422524345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c19e290 con 0x7f226c06b1f0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f226bfff700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 0x7f226c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f225c00d980 tx=0x7f225c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2269ffb700 1 -- 172.21.15.43:0/2422524345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c017070 con 0x7f226c06b1f0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2269ffb700 1 -- 172.21.15.43:0/2422524345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f225c004d00 con 0x7f226c06b1f0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c19e580 con 0x7f226c06b1f0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.054+0000 7f2269ffb700 1 -- 172.21.15.43:0/2422524345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c005500 con 0x7f226c06b1f0 2024-04-25T20:49:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.055+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c1a5e00 con 0x7f226c06b1f0 2024-04-25T20:49:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.057+0000 7f2269ffb700 1 -- 172.21.15.43:0/2422524345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f225c009b40 con 0x7f226c06b1f0 2024-04-25T20:49:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f2269ffb700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 0x7f22540a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f226bfff700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 0x7f22540a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f2269ffb700 1 -- 172.21.15.43:0/2422524345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f225c0d0330 con 0x7f226c06b1f0 2024-04-25T20:49:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f226bfff700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 0x7f22540a6180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226000b5c0 tx=0x7f2260005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f227d8beb80 1 Processor -- start 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.058+0000 7f227d8beb80 1 -- start start 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6429490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6434340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8f637cc40 con 0x55f8f6434880 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f8f63238e0 con 0x55f8f64290b0 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f227d8beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6378c00 con 0x55f8f64299d0 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58884/0 (socket says 172.21.15.43:58884) 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 -- 172.21.15.43:0/1276406610 learned_addr learned my addr 172.21.15.43:0/1276406610 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f2270dd1700 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6429490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f226bfff700 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6434340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 -- 172.21.15.43:0/1276406610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 msgr2=0x55f8f6434340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6434340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 -- 172.21.15.43:0/1276406610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 msgr2=0x55f8f6429490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6429490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 -- 172.21.15.43:0/1276406610 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f62e76f0 con 0x55f8f6434880 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.059+0000 7f22715d2700 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2264009dc0 tx=0x7f22640077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e036c3d1d60c872e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f2252ffd700 1 -- 172.21.15.43:0/1276406610 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264014610 con 0x55f8f6434880 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f2252ffd700 1 -- 172.21.15.43:0/1276406610 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2264019070 con 0x55f8f6434880 2024-04-25T20:49:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f2252ffd700 1 -- 172.21.15.43:0/1276406610 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264013900 con 0x55f8f6434880 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 -- 172.21.15.43:0/1276406610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 msgr2=0x55f8f6436c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2264009dc0 tx=0x7f22640077e0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 -- 172.21.15.43:0/1276406610 shutdown_connections 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f6434880 0x55f8f6436c70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6429490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1276406610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6434340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 -- 172.21.15.43:0/1276406610 >> 172.21.15.43:0/1276406610 conn(0x55f8f6356840 msgr2=0x55f8f6425580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 -- 172.21.15.43:0/1276406610 shutdown_connections 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.060+0000 7f227d8beb80 1 -- 172.21.15.43:0/1276406610 wait complete. 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 -- start start 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 Processor -- start 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6431280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f64317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6437370 con 0x55f8f64290b0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6336560 con 0x55f8f6434880 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f8f64374f0 con 0x55f8f64299d0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f227d8beb80 10 client.0 _ll_register_callbacks cb 0x55f8f63158d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f2270dd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f2270dd1700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58892/0 (socket says 172.21.15.43:58892) 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.061+0000 7f2270dd1700 1 -- 172.21.15.43:0/1050681240 learned_addr learned my addr 172.21.15.43:0/1050681240 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f226bfff700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6431280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f22715d2700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f64317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 -- 172.21.15.43:0/1050681240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 msgr2=0x55f8f6431280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6431280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 -- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 msgr2=0x55f8f64317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f64317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 -- 172.21.15.43:0/1050681240 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f62ca880 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f226bfff700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6431280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f2270dd1700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f225c098300 tx=0x7f225c09c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c83808988ff3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f224bfff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c09c620 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f225c0a4e00 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2264019070 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f225c0a09d0 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f227d8beb80 10 client.15123 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8f6441c40 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.062+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2264019070 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f225c00eba0 con 0x55f8f64290b0 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:49:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 20 client.15123 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64442d0 0x55f8f6445740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 4 client.15123 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8f638a430 con 0x55f8f64442d0 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f226bfff700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64442d0 0x55f8f6445740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f226bfff700 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64442d0 0x55f8f6445740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=845e749e98fd24a3 server_cookie=cf1b3c86cddbf8f4 in_seq=0 out_seq=0 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.063+0000 7f224bfff700 10 client.15123 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.064+0000 7f224bfff700 1 -- 172.21.15.43:0/1050681240 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f8f638a430 con 0x55f8f64442d0 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.064+0000 7f224bfff700 10 client.15123 handle_command_reply: tid=0 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 client.15123 shutdown 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 msgr2=0x55f8f6433f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f225c098300 tx=0x7f225c09c1d0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 shutdown_connections 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f64317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64290b0 0x55f8f6433f80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64442d0 0x55f8f6445740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f224bfff700 0 client.15123 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 --2- 172.21.15.43:0/1050681240 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64299d0 0x55f8f6431280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 >> 172.21.15.43:0/1050681240 conn(0x55f8f6356840 msgr2=0x55f8f64251b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 shutdown_connections 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 1 -- 172.21.15.43:0/1050681240 wait complete. 2024-04-25T20:49:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.065+0000 7f227d8beb80 20 client.15123 trim_cache size 0 max 16384 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.085+0000 7f227d8beb80 1 Processor -- start 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.085+0000 7f227d8beb80 1 -- start start 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6425710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f6434880 0x55f8f642c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6443a80 con 0x55f8f64299d0 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6444150 con 0x55f8f64290b0 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f227d8beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6444820 con 0x55f8f6434880 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58906/0 (socket says 172.21.15.43:58906) 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 -- 172.21.15.43:0/3090205192 learned_addr learned my addr 172.21.15.43:0/3090205192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 -- 172.21.15.43:0/3090205192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f6434880 msgr2=0x55f8f642c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f6434880 0x55f8f642c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 -- 172.21.15.43:0/3090205192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 msgr2=0x55f8f6425710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6425710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 -- 172.21.15.43:0/3090205192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f642f830 con 0x55f8f64299d0 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f226bfff700 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2260009990 tx=0x7f226001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c297bc6565477c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f22527fc700 1 -- 172.21.15.43:0/3090205192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22600333f0 con 0x55f8f64299d0 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f22527fc700 1 -- 172.21.15.43:0/3090205192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22600038d0 con 0x55f8f64299d0 2024-04-25T20:49:46.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.086+0000 7f22527fc700 1 -- 172.21.15.43:0/3090205192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260005410 con 0x55f8f64299d0 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- 172.21.15.43:0/3090205192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 msgr2=0x55f8f644ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2260009990 tx=0x7f226001f000 comp rx=0 tx=0).stop 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- 172.21.15.43:0/3090205192 shutdown_connections 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f6434880 0x55f8f642c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f64290b0 0x55f8f6425710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 --2- 172.21.15.43:0/3090205192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f644ef90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- 172.21.15.43:0/3090205192 >> 172.21.15.43:0/3090205192 conn(0x55f8f6356840 msgr2=0x55f8f642fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- 172.21.15.43:0/3090205192 shutdown_connections 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- 172.21.15.43:0/3090205192 wait complete. 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.087+0000 7f227d8beb80 1 -- start start 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 Processor -- start 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64290b0 0x55f8f642d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f642e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8f64455c0 con 0x55f8f64299d0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6444ef0 con 0x55f8f6434880 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f8f6445c90 con 0x55f8f64290b0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f227d8beb80 10 client.0 _ll_register_callbacks cb 0x55f8f63158d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58922/0 (socket says 172.21.15.43:58922) 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 -- 172.21.15.43:0/2830689173 learned_addr learned my addr 172.21.15.43:0/2830689173 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64290b0 0x55f8f642d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f22715d2700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f642e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 -- 172.21.15.43:0/2830689173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64290b0 msgr2=0x55f8f642d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64290b0 0x55f8f642d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 -- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 msgr2=0x55f8f642e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:46.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f642e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.088+0000 7f226bfff700 1 -- 172.21.15.43:0/2830689173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f64af690 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f226bfff700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f226000bfe0 tx=0x7f22600334a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1513b773325bca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260003c80 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22600038d0 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f2260005070 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2260003e20 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 10 client.15129 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8f64b0950 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22600038d0 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f226000fc70 con 0x55f8f64299d0 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:49:46.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 20 client.15129 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64b4f70 0x55f8f64b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 4 client.15129 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.089+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "status"}) -- 0x55f8f63844d0 con 0x55f8f64b4f70 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64b4f70 0x55f8f64b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f2270dd1700 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64b4f70 0x55f8f64b3c80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d88a46feda507151 server_cookie=bf5600acd1378a76 in_seq=0 out_seq=0 2024-04-25T20:49:46.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f224bfff700 10 client.15129 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:46.095 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:45 smithi043 ceph-mon[29167]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f224bfff700 1 -- 172.21.15.43:0/2830689173 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f8f63844d0 con 0x55f8f64b4f70 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f224bfff700 10 client.15129 handle_command_reply: tid=0 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f227d8beb80 1 client.15129 shutdown 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 msgr2=0x55f8f642dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f226000bfe0 tx=0x7f22600334a0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 shutdown_connections 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.090+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55f8f64b4f70 0x55f8f64b3c80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f224bfff700 0 client.15129 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f8f64290b0 0x55f8f642d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f8f6434880 0x55f8f642e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 --2- 172.21.15.43:0/2830689173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8f64299d0 0x55f8f642dc50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 >> 172.21.15.43:0/2830689173 conn(0x55f8f6356840 msgr2=0x55f8f642c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 shutdown_connections 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 1 -- 172.21.15.43:0/2830689173 wait complete. 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.091+0000 7f227d8beb80 20 client.15129 trim_cache size 0 max 16384 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:46.097 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24449, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 183.629234118, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 227.54851164900001 2024-04-25T20:49:46.098 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 msgr2=0x7f22540a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 0x7f22540a6180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226000b5c0 tx=0x7f2260005fd0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 msgr2=0x7f226c199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f225c00d980 tx=0x7f225c00dd40 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 shutdown_connections 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f22540a3cc0 0x7f22540a6180 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f226c108a60 0x7f226c19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f226c06b1f0 0x7f226c199280 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 --2- 172.21.15.43:0/2422524345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f226c06bbb0 0x7f226c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 >> 172.21.15.43:0/2422524345 conn(0x7f226c0789e0 msgr2=0x7f226c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:46.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 shutdown_connections 2024-04-25T20:49:46.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:46.092+0000 7f2273035700 1 -- 172.21.15.43:0/2422524345 wait complete. 2024-04-25T20:49:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:45 smithi195 ceph-mon[33250]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:45 smithi112 ceph-mon[32322]: pgmap v401: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-04-25T20:49:46.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-25T20:49:47.089 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:48.271 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:47 smithi043 ceph-mon[29167]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:47 smithi195 ceph-mon[33250]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:48.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:47 smithi112 ceph-mon[32322]: pgmap v402: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2122495993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 msgr2=0x7fb9e010f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2122495993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e010f830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b0a0 tx=0x7fb9d800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2122495993 shutdown_connections 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2122495993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e010f830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2122495993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e0107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2122495993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 0x7fb9e0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2122495993 >> 172.21.15.43:0/2122495993 conn(0x7fb9e0076c60 msgr2=0x7fb9e0077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2122495993 shutdown_connections 2024-04-25T20:49:48.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.842+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2122495993 wait complete. 2024-04-25T20:49:48.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 Processor -- start 2024-04-25T20:49:48.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 -- start start 2024-04-25T20:49:48.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 0x7fb9e0199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0112dd0 con 0x7fb9e0101dc0 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0112c50 con 0x7fb9e0107b20 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e6a76700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0112f50 con 0x7fb9e0101400 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58938/0 (socket says 172.21.15.43:58938) 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e4812700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 0x7fb9e0199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9dffff700 1 -- 172.21.15.43:0/2870699124 learned_addr learned my addr 172.21.15.43:0/2870699124 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.843+0000 7fb9e5013700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 -- 172.21.15.43:0/2870699124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 msgr2=0x7fb9e0199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 0x7fb9e0199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 -- 172.21.15.43:0/2870699124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 msgr2=0x7fb9e019d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e019d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 -- 172.21.15.43:0/2870699124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e019e0c0 con 0x7fb9e0101dc0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9e5013700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9dffff700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c9b0 tx=0x7fb9d400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9ddffb700 1 -- 172.21.15.43:0/2870699124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4007b00 con 0x7fb9e0101dc0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9ddffb700 1 -- 172.21.15.43:0/2870699124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d4007ca0 con 0x7fb9e0101dc0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e019e3b0 con 0x7fb9e0101dc0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9ddffb700 1 -- 172.21.15.43:0/2870699124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4018680 con 0x7fb9e0101dc0 2024-04-25T20:49:48.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.844+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01a5c30 con 0x7fb9e0101dc0 2024-04-25T20:49:48.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.847+0000 7fb9ddffb700 1 -- 172.21.15.43:0/2870699124 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fb9d400f450 con 0x7fb9e0101dc0 2024-04-25T20:49:48.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.847+0000 7fb9ddffb700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 0x7fb9c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.847+0000 7fb9e4812700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 0x7fb9c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.847+0000 7fb9ddffb700 1 -- 172.21.15.43:0/2870699124 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb9d40d03e0 con 0x7fb9e0101dc0 2024-04-25T20:49:48.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.848+0000 7fb9e4812700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 0x7fb9c80a6100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00781e0 tx=0x7fb9d000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.848+0000 7fb9f12ffb80 1 Processor -- start 2024-04-25T20:49:48.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.848+0000 7fb9f12ffb80 1 -- start start 2024-04-25T20:49:48.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640f152dc40 con 0x5640f15e5880 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5640f14d48e0 con 0x5640f15da9d0 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5640f1529c00 con 0x5640f15da0b0 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:57496/0 (socket says 172.21.15.43:57496) 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 -- 172.21.15.43:0/4290991063 learned_addr learned my addr 172.21.15.43:0/4290991063 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58954/0 (socket says 172.21.15.43:58954) 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 -- 172.21.15.43:0/4290991063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 msgr2=0x5640f15e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 -- 172.21.15.43:0/4290991063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 msgr2=0x5640f15e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 -- 172.21.15.43:0/4290991063 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f14986f0 con 0x5640f15da0b0 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9e4812700 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000fd80 tx=0x7fb9d0012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9dc79f6ec4bcbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.849+0000 7fb9c6ffd700 1 -- 172.21.15.43:0/4290991063 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0016070 con 0x5640f15da0b0 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9c6ffd700 1 -- 172.21.15.43:0/4290991063 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d0010d90 con 0x5640f15da0b0 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9c6ffd700 1 -- 172.21.15.43:0/4290991063 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d001c420 con 0x5640f15da0b0 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/4290991063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 msgr2=0x5640f15da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000fd80 tx=0x7fb9d0012000 comp rx=0 tx=0).stop 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/4290991063 shutdown_connections 2024-04-25T20:49:48.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15da490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/4290991063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/4290991063 >> 172.21.15.43:0/4290991063 conn(0x5640f1507840 msgr2=0x5640f15d6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/4290991063 shutdown_connections 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.850+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/4290991063 wait complete. 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 -- start start 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 Processor -- start 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640f15e8370 con 0x5640f15e5880 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5640f14e7560 con 0x5640f15da9d0 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5640f15e84f0 con 0x5640f15da0b0 2024-04-25T20:49:48.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9f12ffb80 10 client.0 _ll_register_callbacks cb 0x5640f14c68d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58960/0 (socket says 172.21.15.43:58960) 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9e5013700 1 -- 172.21.15.43:0/1298020653 learned_addr learned my addr 172.21.15.43:0/1298020653 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.851+0000 7fb9dffff700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e4812700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 -- 172.21.15.43:0/1298020653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 msgr2=0x5640f15e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 -- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 msgr2=0x5640f15e2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 -- 172.21.15.43:0/1298020653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f147b880 con 0x5640f15e5880 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9dffff700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9e5013700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b0a0 tx=0x7fb9d8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99b7c8b17afdc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9bffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:48.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80078f0 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb9d8007a90 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d0010d90 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9d8007c90 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9f12ffb80 10 client.15141 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.852+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640f15f2c30 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d0010d90 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb9d8011070 con 0x5640f15e5880 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 20 client.15141 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f15f5260 0x5640f15f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 4 client.15141 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640f153b430 con 0x5640f15f5260 2024-04-25T20:49:48.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9e4812700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f15f5260 0x5640f15f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9e4812700 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f15f5260 0x5640f15f66d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b28466f5daf8696a server_cookie=9e2705c6af3eee4b in_seq=0 out_seq=0 2024-04-25T20:49:48.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.853+0000 7fb9bffff700 10 client.15141 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9bffff700 1 -- 172.21.15.43:0/1298020653 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5640f153b430 con 0x5640f15f5260 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9bffff700 10 client.15141 handle_command_reply: tid=0 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 client.15141 shutdown 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 msgr2=0x5640f15e2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b0a0 tx=0x7fb9d8004c80 comp rx=0 tx=0).stop 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 shutdown_connections 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f15f5260 0x5640f15f66d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15e2840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/1298020653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da9d0 0x5640f15e2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.854+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 >> 172.21.15.43:0/1298020653 conn(0x5640f1507840 msgr2=0x5640f15d61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.855+0000 7fb9bffff700 0 client.15141 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:48.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.855+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 shutdown_connections 2024-04-25T20:49:48.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.855+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/1298020653 wait complete. 2024-04-25T20:49:48.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.855+0000 7fb9f12ffb80 20 client.15141 trim_cache size 0 max 16384 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 Processor -- start 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 -- start start 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da0b0 0x5640f15e2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da9d0 0x5640f15e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f4a10 con 0x5640f15e5880 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f50e0 con 0x5640f15da0b0 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.875+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f57b0 con 0x5640f15da9d0 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58962/0 (socket says 172.21.15.43:58962) 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 -- 172.21.15.43:0/412833321 learned_addr learned my addr 172.21.15.43:0/412833321 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9dffff700 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da9d0 0x5640f15e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e4812700 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da0b0 0x5640f15e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 -- 172.21.15.43:0/412833321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da9d0 msgr2=0x5640f15e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da9d0 0x5640f15e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 -- 172.21.15.43:0/412833321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da0b0 msgr2=0x5640f15e2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da0b0 0x5640f15e2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 -- 172.21.15.43:0/412833321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640f15dbf20 con 0x5640f15e5880 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9e5013700 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000f80 tx=0x7fb9d8009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b591f62e30d3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9c67fc700 1 -- 172.21.15.43:0/412833321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8036020 con 0x5640f15e5880 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9c67fc700 1 -- 172.21.15.43:0/412833321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d8005c60 con 0x5640f15e5880 2024-04-25T20:49:48.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.876+0000 7fb9c67fc700 1 -- 172.21.15.43:0/412833321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8027da0 con 0x5640f15e5880 2024-04-25T20:49:48.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/412833321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 msgr2=0x5640f15d6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000f80 tx=0x7fb9d8009650 comp rx=0 tx=0).stop 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/412833321 shutdown_connections 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15e5880 0x5640f15d6060 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15da0b0 0x5640f15e2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/412833321 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da9d0 0x5640f15e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/412833321 >> 172.21.15.43:0/412833321 conn(0x5640f1507840 msgr2=0x5640f15d5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/412833321 shutdown_connections 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/412833321 wait complete. 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 -- start start 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.877+0000 7fb9f12ffb80 1 Processor -- start 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 0x5640f15df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f6550 con 0x5640f15da9d0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f5e80 con 0x5640f15e5880 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5640f15f6c20 con 0x5640f15da0b0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9f12ffb80 10 client.0 _ll_register_callbacks cb 0x5640f14c68d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58966/0 (socket says 172.21.15.43:58966) 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 -- 172.21.15.43:0/3659701674 learned_addr learned my addr 172.21.15.43:0/3659701674 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9e4812700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9e5013700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 0x5640f15df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 -- 172.21.15.43:0/3659701674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 msgr2=0x5640f15ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 -- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 msgr2=0x5640f15df1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:49:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 0x5640f15df1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 -- 172.21.15.43:0/3659701674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640f15dfa20 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9e5013700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 0x5640f15df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9dffff700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400afd0 tx=0x7fb9d4098a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83942a8edad8031 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9bffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40b9030 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.878+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb9d400de00 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d8005c60 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9d409c6b0 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 10 client.15147 fetch_fsmap learned FSMap version 27 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640f165c450 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9d8005c60 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb9d400f860 con 0x5640f15da9d0 2024-04-25T20:49:48.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 20 client.15147 populate_metadata read hostname 'smithi043' 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f1661040 0x5640f165fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 4 client.15147 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "status"}) -- 0x5640f15354d0 con 0x5640f1661040 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.879+0000 7fb9e4812700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f1661040 0x5640f165fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9e4812700 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f1661040 0x5640f165fd50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab04b97cda4b51bf server_cookie=5239ac5747ddf2bc in_seq=0 out_seq=0 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9bffff700 10 client.15147 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9bffff700 1 -- 172.21.15.43:0/3659701674 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5640f15354d0 con 0x5640f1661040 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9bffff700 10 client.15147 handle_command_reply: tid=0 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 client.15147 shutdown 2024-04-25T20:49:48.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 msgr2=0x5640f15dec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400afd0 tx=0x7fb9d4098a00 comp rx=0 tx=0).stop 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 shutdown_connections 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5640f1661040 0x5640f165fd50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9bffff700 0 client.15147 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640f15da0b0 0x5640f15ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5640f15e5880 0x5640f15df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 --2- 172.21.15.43:0/3659701674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5640f15da9d0 0x5640f15dec70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 >> 172.21.15.43:0/3659701674 conn(0x5640f1507840 msgr2=0x5640f15d6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 shutdown_connections 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 1 -- 172.21.15.43:0/3659701674 wait complete. 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.880+0000 7fb9f12ffb80 20 client.15147 trim_cache size 0 max 16384 2024-04-25T20:49:48.887 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24470, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 200.39324384700001, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 27, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 91, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 89, 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 216.53135720700001 2024-04-25T20:49:48.888 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 msgr2=0x7fb9c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 0x7fb9c80a6100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00781e0 tx=0x7fb9d000a380 comp rx=0 tx=0).stop 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 msgr2=0x7fb9e0199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c9b0 tx=0x7fb9d400ccc0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 shutdown_connections 2024-04-25T20:49:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb9c80a3c40 0x7fb9c80a6100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9e0101400 0x7fb9e0199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb9e0107b20 0x7fb9e019d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 --2- 172.21.15.43:0/2870699124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9e0101dc0 0x7fb9e0199640 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 >> 172.21.15.43:0/2870699124 conn(0x7fb9e0076c60 msgr2=0x7fb9e00ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 shutdown_connections 2024-04-25T20:49:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:48.881+0000 7fb9e6a76700 1 -- 172.21.15.43:0/2870699124 wait complete. 2024-04-25T20:49:49.661 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T20:49:49.674 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T20:49:49.675 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T20:49:49.675 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T20:49:49.675 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-25T20:49:49.676 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T20:49:49.676 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:49:49.676 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-25T20:49:49.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 -- 172.21.15.43:0/1914807835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 msgr2=0x7f644010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:49.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 --2- 172.21.15.43:0/1914807835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f644010a440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6438009ca0 tx=0x7f643802a8c0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 -- 172.21.15.43:0/1914807835 shutdown_connections 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 --2- 172.21.15.43:0/1914807835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f644010a440 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 --2- 172.21.15.43:0/1914807835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64401031f0 0x7f6440103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 --2- 172.21.15.43:0/1914807835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6440102000 0x7f6440102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 -- 172.21.15.43:0/1914807835 >> 172.21.15.43:0/1914807835 conn(0x7f64400fd570 msgr2=0x7f64400ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 -- 172.21.15.43:0/1914807835 shutdown_connections 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.781+0000 7f64480d0640 1 -- 172.21.15.43:0/1914807835 wait complete. 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 Processor -- start 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 -- start start 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6440102000 0x7f6440075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64401031f0 0x7f6440074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f644010dc60 con 0x7f6440103bb0 2024-04-25T20:49:49.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f644010dae0 con 0x7f64401031f0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f64480d0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f644010dde0 con 0x7f6440102000 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58984/0 (socket says 172.21.15.43:58984) 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 -- 172.21.15.43:0/1182610238 learned_addr learned my addr 172.21.15.43:0/1182610238 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f6445e6c640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6440102000 0x7f6440075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644566b640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64401031f0 0x7f6440074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 -- 172.21.15.43:0/1182610238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6440102000 msgr2=0x7f6440075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6440102000 0x7f6440075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 -- 172.21.15.43:0/1182610238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64401031f0 msgr2=0x7f6440074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.782+0000 7f644666d640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64401031f0 0x7f6440074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f644666d640 1 -- 172.21.15.43:0/1182610238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6440075110 con 0x7f6440103bb0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f644666d640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6438009dc0 tx=0x7f643802f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438003cf0 con 0x7f6440103bb0 2024-04-25T20:49:49.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6438004510 con 0x7f6440103bb0 2024-04-25T20:49:49.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64401a22e0 con 0x7f6440103bb0 2024-04-25T20:49:49.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643802fdb0 con 0x7f6440103bb0 2024-04-25T20:49:49.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.783+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64401a2880 con 0x7f6440103bb0 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.784+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6440109250 con 0x7f6440103bb0 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.785+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f64380046c0 con 0x7f6440103bb0 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.786+0000 7f6436ffd640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 0x7f642c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.786+0000 7f6445e6c640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 0x7f642c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.786+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f64380f1c10 con 0x7f6440103bb0 2024-04-25T20:49:49.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.786+0000 7f6445e6c640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 0x7f642c0a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6440103050 tx=0x7f643c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:49.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:49.789+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f64380be600 con 0x7f6440103bb0 2024-04-25T20:49:50.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.032+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f644002d5c0 con 0x7f6440103bb0 2024-04-25T20:49:50.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:49 smithi043 ceph-mon[29167]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:49 smithi195 ceph-mon[33250]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:49 smithi112 ceph-mon[32322]: pgmap v403: 97 pgs: 97 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-25T20:49:50.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.985+0000 7f6436ffd640 1 -- 172.21.15.43:0/1182610238 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f64380bdf00 con 0x7f6440103bb0 2024-04-25T20:49:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 msgr2=0x7f642c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 0x7f642c0a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6440103050 tx=0x7f643c00b390 comp rx=0 tx=0).stop 2024-04-25T20:49:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 msgr2=0x7f6440074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:50.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6438009dc0 tx=0x7f643802f460 comp rx=0 tx=0).stop 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 shutdown_connections 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f642c0a3cd0 0x7f642c0a6190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6440103bb0 0x7f6440074880 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f64401031f0 0x7f6440074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 --2- 172.21.15.43:0/1182610238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6440102000 0x7f6440075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.991+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 >> 172.21.15.43:0/1182610238 conn(0x7f64400fd570 msgr2=0x7f6440106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:50.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.992+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 shutdown_connections 2024-04-25T20:49:50.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:50.992+0000 7f64480d0640 1 -- 172.21.15.43:0/1182610238 wait complete. 2024-04-25T20:49:51.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 -- 172.21.15.43:0/3645582204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 msgr2=0x7fe210101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 --2- 172.21.15.43:0/3645582204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210101280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009900 tx=0x7fe1f802a410 comp rx=0 tx=0).stop 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 -- 172.21.15.43:0/3645582204 shutdown_connections 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 --2- 172.21.15.43:0/3645582204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe210109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 --2- 172.21.15.43:0/3645582204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe2101024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 --2- 172.21.15.43:0/3645582204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210101280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 -- 172.21.15.43:0/3645582204 >> 172.21.15.43:0/3645582204 conn(0x7fe2100fc420 msgr2=0x7fe2100fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 -- 172.21.15.43:0/3645582204 shutdown_connections 2024-04-25T20:49:51.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.120+0000 7fe2156a0640 1 -- 172.21.15.43:0/3645582204 wait complete. 2024-04-25T20:49:51.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 Processor -- start 2024-04-25T20:49:51.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 -- start start 2024-04-25T20:49:51.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe210197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe21019e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe21010cb30 con 0x7fe210100e60 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe21010c9b0 con 0x7fe210102a00 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe2156a0640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe21010ccb0 con 0x7fe210102040 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe20effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe20effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59004/0 (socket says 172.21.15.43:59004) 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe20effd640 1 -- 172.21.15.43:0/4264355814 learned_addr learned my addr 172.21.15.43:0/4264355814 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe20e7fc640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe210197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.121+0000 7fe20f7fe640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe21019e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 -- 172.21.15.43:0/4264355814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 msgr2=0x7fe210197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe210197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 -- 172.21.15.43:0/4264355814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 msgr2=0x7fe21019e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe21019e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 -- 172.21.15.43:0/4264355814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21019ed70 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20e7fc640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe210197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20f7fe640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe21019e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe20effd640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8006010 tx=0x7fe1f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f803f030 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21019f000 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1f8003cd0 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8035070 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.122+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21019f540 con 0x7fe210100e60 2024-04-25T20:49:51.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.123+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe210108200 con 0x7fe210100e60 2024-04-25T20:49:51.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.125+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fe1f8042030 con 0x7fe210100e60 2024-04-25T20:49:51.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.126+0000 7fe207fff640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 0x7fe1fc0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.126+0000 7fe20e7fc640 1 -- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 msgr2=0x7fe1fc0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:51.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.126+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fe1f80f08d0 con 0x7fe210100e60 2024-04-25T20:49:51.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.126+0000 7fe20e7fc640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 0x7fe1fc0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:49:51.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.130+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe1f80bcc10 con 0x7fe210100e60 2024-04-25T20:49:51.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:50 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T20:49:51.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setuser ceph since I am not root 2024-04-25T20:49:51.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: ignoring --setgroup ceph since I am not root 2024-04-25T20:49:51.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:51.181+0000 7f8884d60200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:49:51.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.319+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fe21002d5c0 con 0x7fe210100e60 2024-04-25T20:49:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.323+0000 7fe207fff640 1 -- 172.21.15.43:0/4264355814 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7fe1f80c0f10 con 0x7fe210100e60 2024-04-25T20:49:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 msgr2=0x7fe1fc0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:49:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 0x7fe1fc0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 msgr2=0x7fe210197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8006010 tx=0x7fe1f80042f0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 shutdown_connections 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fe1fc0a3ca0 0x7fe1fc0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe210102a00 0x7fe21019e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe210102040 0x7fe210197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 --2- 172.21.15.43:0/4264355814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe210100e60 0x7fe210197150 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 >> 172.21.15.43:0/4264355814 conn(0x7fe2100fc420 msgr2=0x7fe2101053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 shutdown_connections 2024-04-25T20:49:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.325+0000 7fe2156a0640 1 -- 172.21.15.43:0/4264355814 wait complete. 2024-04-25T20:49:51.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-25T20:49:51.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:50 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T20:49:51.341 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: ignoring --setuser ceph since I am not root 2024-04-25T20:49:51.341 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: ignoring --setgroup ceph since I am not root 2024-04-25T20:49:51.341 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-mgr[35091]: -- 172.21.15.195:0/2116750880 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dfa38865a0 con 0x55dfa385ac00 2024-04-25T20:49:51.342 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:51.171+0000 7fec3638b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:49:51.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:50 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T20:49:51.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: ignoring --setuser ceph since I am not root 2024-04-25T20:49:51.343 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: ignoring --setgroup ceph since I am not root 2024-04-25T20:49:51.343 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-mgr[33752]: -- 172.21.15.112:0/2042053972 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573286405a0 con 0x557328615000 2024-04-25T20:49:51.343 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:51.171+0000 7f0d99b7b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T20:49:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- 172.21.15.43:0/689006533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 msgr2=0x7f7af0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 --2- 172.21.15.43:0/689006533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af0107750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009900 tx=0x7f7ae002a410 comp rx=0 tx=0).stop 2024-04-25T20:49:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- 172.21.15.43:0/689006533 shutdown_connections 2024-04-25T20:49:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 --2- 172.21.15.43:0/689006533 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0107c90 0x7f7af010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 --2- 172.21.15.43:0/689006533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af0107750 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 --2- 172.21.15.43:0/689006533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0102a30 0x7f7af0104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- 172.21.15.43:0/689006533 >> 172.21.15.43:0/689006533 conn(0x7f7af00fc420 msgr2=0x7f7af00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- 172.21.15.43:0/689006533 shutdown_connections 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- 172.21.15.43:0/689006533 wait complete. 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 Processor -- start 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.441+0000 7f7af5842640 1 -- start start 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 0x7f7af01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0107c90 0x7f7af019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010dc60 con 0x7f7af0105360 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010dae0 con 0x7f7af0102a30 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af5842640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010dde0 con 0x7f7af0107c90 2024-04-25T20:49:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59014/0 (socket says 172.21.15.43:59014) 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 -- 172.21.15.43:0/1730645425 learned_addr learned my addr 172.21.15.43:0/1730645425 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aeeffd640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 0x7f7af01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aef7fe640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0107c90 0x7f7af019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 -- 172.21.15.43:0/1730645425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0107c90 msgr2=0x7f7af019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0107c90 0x7f7af019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 -- 172.21.15.43:0/1730645425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 msgr2=0x7f7af01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 0x7f7af01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 -- 172.21.15.43:0/1730645425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af019fec0 con 0x7f7af0105360 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aeeffd640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 0x7f7af01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7aee7fc640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0031570 tx=0x7f7ae0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae003f030 con 0x7f7af0105360 2024-04-25T20:49:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.442+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ae0032e30 con 0x7f7af0105360 2024-04-25T20:49:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.443+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af01a0150 con 0x7f7af0105360 2024-04-25T20:49:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.443+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0035070 con 0x7f7af0105360 2024-04-25T20:49:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.443+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af01a0640 con 0x7f7af0105360 2024-04-25T20:49:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.444+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af00fdf10 con 0x7f7af0105360 2024-04-25T20:49:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.445+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f7ae0042030 con 0x7f7af0105360 2024-04-25T20:49:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.446+0000 7f7af4840640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 0x7f7ad80a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.446+0000 7f7aeeffd640 1 -- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 msgr2=0x7f7ad80a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.446+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7f7ae00f0c20 con 0x7f7af0105360 2024-04-25T20:49:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.446+0000 7f7aeeffd640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 0x7f7ad80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:49:51.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.450+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7ae00bcfc0 con 0x7f7af0105360 2024-04-25T20:49:51.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.639+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f7af0062bc0 con 0x7f7af0105360 2024-04-25T20:49:51.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.643+0000 7f7af4840640 1 -- 172.21.15.43:0/1730645425 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f7ae00c12c0 con 0x7f7af0105360 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 msgr2=0x7f7ad80a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 0x7f7ad80a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 msgr2=0x7f7af01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0031570 tx=0x7f7ae0032c40 comp rx=0 tx=0).stop 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 shutdown_connections 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7f7ad80a3ca0 0x7f7ad80a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7af0107c90 0x7f7af019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7af0105360 0x7f7af01987e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 --2- 172.21.15.43:0/1730645425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7af0102a30 0x7f7af01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:51.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 >> 172.21.15.43:0/1730645425 conn(0x7f7af00fc420 msgr2=0x7f7af0103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:51.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 shutdown_connections 2024-04-25T20:49:51.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:51.645+0000 7f7af5842640 1 -- 172.21.15.43:0/1730645425 wait complete. 2024-04-25T20:49:51.656 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:51.376+0000 7f8884d60200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:51.656 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:51.488+0000 7f8884d60200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:49:51.657 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T20:49:51.682 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T20:49:51.682 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T20:49:51.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:51.683 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T20:49:51.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:51.700 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T20:49:51.767 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-04-25T20:49:51.767 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:51.356+0000 7f0d99b7b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:51.767 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:51.458+0000 7f0d99b7b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:49:51.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T20:49:51.768 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-04-25T20:49:51.769 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T20:49:51.769 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T20:49:51.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T20:49:51.771 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:51.358+0000 7fec3638b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:51.771 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:51.459+0000 7fec3638b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T20:49:51.771 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:51.770+0000 7fec3638b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:49:51.910 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:51.818+0000 7f8884d60200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:49:52.076 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:49:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T20:49:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-mon[33250]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-25T20:49:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4264355814' entity='client.admin' 2024-04-25T20:49:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1730645425' entity='client.admin' 2024-04-25T20:49:52.092 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:51.856+0000 7fec3638b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:49:52.092 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:51.767+0000 7f0d99b7b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T20:49:52.092 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:51.852+0000 7f0d99b7b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:49:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T20:49:52.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-mon[32322]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-25T20:49:52.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4264355814' entity='client.admin' 2024-04-25T20:49:52.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1730645425' entity='client.admin' 2024-04-25T20:49:52.199 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:51.909+0000 7f8884d60200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T20:49:52.199 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1182610238' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T20:49:52.199 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-mon[29167]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-25T20:49:52.200 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4264355814' entity='client.admin' 2024-04-25T20:49:52.200 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1730645425' entity='client.admin' 2024-04-25T20:49:53.341 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.031+0000 7fec3638b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:49:53.342 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.198+0000 7fec3638b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:53.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.030+0000 7f0d99b7b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:49:53.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.199+0000 7f0d99b7b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:53.488 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:53.200+0000 7f8884d60200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T20:49:53.488 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:53.384+0000 7f8884d60200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:53.660 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.367+0000 7fec3638b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:49:53.663 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.370+0000 7f0d99b7b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:49:53.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:53.572+0000 7f8884d60200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 -- 172.21.15.43:0/4079942090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 msgr2=0x7fb7c0107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/4079942090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c0107d70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009990 tx=0x7fb7b4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 -- 172.21.15.43:0/4079942090 shutdown_connections 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/4079942090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/4079942090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c0107d70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/4079942090 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 -- 172.21.15.43:0/4079942090 >> 172.21.15.43:0/4079942090 conn(0x7fb7c00788f0 msgr2=0x7fb7c0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 -- 172.21.15.43:0/4079942090 shutdown_connections 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 -- 172.21.15.43:0/4079942090 wait complete. 2024-04-25T20:49:53.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.925+0000 7fb7c71d9700 1 Processor -- start 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 -- start start 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0111c10 con 0x7fb7c0107990 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0111a90 con 0x7fb7c0101940 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c71d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0111d90 con 0x7fb7c0102300 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c5776700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c4f75700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c5776700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59034/0 (socket says 172.21.15.43:59034) 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c5776700 1 -- 172.21.15.43:0/1216884676 learned_addr learned my addr 172.21.15.43:0/1216884676 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:57600/0 (socket says 172.21.15.43:57600) 2024-04-25T20:49:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c4f75700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:41678/0 (socket says 172.21.15.43:41678) 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 msgr2=0x7fb7c0199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 msgr2=0x7fb7c019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7bffff700 1 -- 172.21.15.43:0/1216884676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c019e1a0 con 0x7fb7c0102300 2024-04-25T20:49:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.926+0000 7fb7c5776700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7bffff700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00e9f0 tx=0x7fb7ac00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00c9c0 con 0x7fb7c0102300 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c019e490 con 0x7fb7c0102300 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb7ac00cb60 con 0x7fb7c0102300 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac018680 con 0x7fb7c0102300 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.927+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c01a5d10 con 0x7fb7c0102300 2024-04-25T20:49:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.928+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c0069730 con 0x7fb7c0102300 2024-04-25T20:49:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.930+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fb7ac010430 con 0x7fb7c0102300 2024-04-25T20:49:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.930+0000 7fb7bdffb700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 0x7fb7b00a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.930+0000 7fb7c4f75700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 msgr2=0x7fb7b00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.931+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb7ac0d0610 con 0x7fb7c0102300 2024-04-25T20:49:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.931+0000 7fb7c4f75700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 0x7fb7b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:49:53.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:53.935+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb7ac09cfa0 con 0x7fb7c0102300 2024-04-25T20:49:53.955 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.658+0000 7fec3638b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:49:53.955 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.750+0000 7fec3638b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:49:53.955 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:53.954+0000 7fec3638b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:49:53.958 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.662+0000 7f0d99b7b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:49:53.958 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.755+0000 7f0d99b7b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:49:54.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.132+0000 7fb7c4f75700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 msgr2=0x7fb7b00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:54.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.132+0000 7fb7c4f75700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 0x7fb7b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:49:54.133 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:53.882+0000 7f8884d60200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T20:49:54.133 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:53.984+0000 7f8884d60200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T20:49:54.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.191+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7c019a4f0 con 0x7fb7c0102300 2024-04-25T20:49:54.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.192+0000 7fb7bdffb700 1 -- 172.21.15.43:0/1216884676 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fb7c019a4f0 con 0x7fb7c0102300 2024-04-25T20:49:54.193 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T20:49:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.194+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 msgr2=0x7fb7b00a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:49:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.194+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 0x7fb7b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.194+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 msgr2=0x7fb7c01996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.194+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00e9f0 tx=0x7fb7ac00ed00 comp rx=0 tx=0).stop 2024-04-25T20:49:54.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.194+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 shutdown_connections 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb7b00a3c90 0x7fb7b00a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7c0107990 0x7fb7c019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb7c0101940 0x7fb7c0199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 --2- 172.21.15.43:0/1216884676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7c0102300 0x7fb7c01996d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 >> 172.21.15.43:0/1216884676 conn(0x7fb7c00788f0 msgr2=0x7fb7c006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 shutdown_connections 2024-04-25T20:49:54.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:54.195+0000 7fb7c71d9700 1 -- 172.21.15.43:0/1216884676 wait complete. 2024-04-25T20:49:54.244 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:54.147+0000 7fec3638b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:54.245 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:53.957+0000 7f0d99b7b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:49:54.245 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:54.150+0000 7f0d99b7b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:54.407 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:54 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1216884676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T20:49:54.407 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:54.200+0000 7f8884d60200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T20:49:54.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:54 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1216884676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T20:49:54.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:54 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1216884676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T20:49:54.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:54.406+0000 7f8884d60200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T20:49:54.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T20:49:54.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T20:49:54.933 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T20:49:54.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:54.933 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-04-25T20:49:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 41998sec preferred_lft 41998sec 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link noprefixroute 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-04-25T20:49:54.951 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-04-25T20:49:54.952 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T20:49:54.952 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T20:49:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:55.091 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:54.742+0000 7fec3638b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:49:55.092 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:54.745+0000 7f0d99b7b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:49:55.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:55.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:55.140 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T20:49:55.154 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:55.045+0000 7f8884d60200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T20:49:55.166 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-04-25T20:49:55.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:55.168 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-04-25T20:49:55.245 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-04-25T20:49:55.245 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T20:49:55.245 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T20:49:55.245 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T20:49:55.245 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T20:49:55.246 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T20:49:55.247 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T20:49:55.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T20:49:55.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T20:49:55.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T20:49:55.247 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T20:49:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:55.455 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:55.159+0000 7fec3638b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:49:55.455 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:55.254+0000 7fec3638b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:49:55.455 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:55.454+0000 7fec3638b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:49:55.469 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:55.167+0000 7f0d99b7b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:49:55.469 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:55.264+0000 7f0d99b7b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:49:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:55.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:55.526 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T20:49:55.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:55.542 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-04-25T20:49:55.598 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T20:49:55.598 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T20:49:55.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T20:49:55.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T20:49:55.598 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T20:49:55.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:55.697 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:55.522+0000 7f8884d60200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T20:49:55.697 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:55.628+0000 7f8884d60200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T20:49:55.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:55.724 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T20:49:55.724 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T20:49:55.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:55.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:55.468+0000 7f0d99b7b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:49:55.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:55.858 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T20:49:55.858 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-04-25T20:49:55.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-04-25T20:49:55.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T20:49:55.858 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-04-25T20:49:55.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:55.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:55.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T20:49:55.939 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T20:49:55.954 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T20:49:55.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T20:49:55.954 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T20:49:56.009 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-25T20:49:56.009 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-25T20:49:56.009 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/a8ff5fa1-73ab-4768-a331-eb33910e945c 2024-04-25T20:49:56.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:56.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/a8ff5fa1-73ab-4768-a331-eb33910e945c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-04-25T20:49:56.024 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:55.860+0000 7f8884d60200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T20:49:56.085 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-04-25T20:49:56.086 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-04-25T20:49:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-04-25T20:49:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-04-25T20:49:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.112:3300,172.21.15.195:3300" 2024-04-25T20:49:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with new device syntax: 0@92e6f50e-0343-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/a8ff5fa1-73ab-4768-a331-eb33910e945c 2024-04-25T20:49:56.204 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,name=0,key=0,mon_addr=172.21.15.43:3300/172.21.15.112:3300/172.21.15.195:3300" will pass to kernel 2024-04-25T20:49:56.205 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T20:49:56.205 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-04-25T20:49:56.205 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T20:49:56.205 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T20:49:56.205 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T20:49:56.207 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T20:49:56.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T20:49:56.207 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T20:49:56.236 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T20:49:56.304 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:55.974+0000 7fec3638b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:49:56.304 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.065+0000 7fec3638b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:49:56.326 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:55.989+0000 7f0d99b7b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:49:56.327 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.082+0000 7f0d99b7b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:49:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T20:49:56.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:56.337 INFO:teuthology.orchestra.run.smithi043.stdout:client24932 2024-04-25T20:49:56.338 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:49:56.338 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T20:49:56.357 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T20:49:56.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T20:49:56.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:56.458 INFO:teuthology.orchestra.run.smithi043.stdout:client24932 2024-04-25T20:49:56.458 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T20:49:56.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T20:49:56.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:56.527 INFO:teuthology.orchestra.run.smithi043.stdout:client24932 2024-04-25T20:49:56.528 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/92e6f50e-0343-11ef-bc93-c7b262605968.client24932/status') 2024-04-25T20:49:56.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T20:49:56.586 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:56.439+0000 7f8884d60200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T20:49:56.587 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:56.546+0000 7f8884d60200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T20:49:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.24932 (3)172.21.15.43:0/159109213 2024-04-25T20:49:56.589 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-04-25T20:49:56.590 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-04-25T20:49:56.590 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-04-25T20:49:56.590 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 2.8021e-05 s, 2.5 MB/s 2024-04-25T20:49:56.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T20:49:56.591 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.303+0000 7fec3638b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:49:56.591 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.434+0000 7fec3638b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:49:56.591 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.528+0000 7fec3638b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:49:56.592 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.326+0000 7f0d99b7b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:49:56.592 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.458+0000 7f0d99b7b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:49:56.592 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.552+0000 7f0d99b7b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:49:56.597 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T20:49:56.610 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T20:49:56.610 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:49:56.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-25T20:49:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 -- 172.21.15.43:0/668096279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0105360 msgr2=0x7fb1f0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/668096279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0105360 0x7fb1f0107750 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009900 tx=0x7fb1dc02a410 comp rx=0 tx=0).stop 2024-04-25T20:49:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 -- 172.21.15.43:0/668096279 shutdown_connections 2024-04-25T20:49:56.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/668096279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0107c90 0x7fb1f010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/668096279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0105360 0x7fb1f0107750 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/668096279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f0104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 -- 172.21.15.43:0/668096279 >> 172.21.15.43:0/668096279 conn(0x7fb1f00fc420 msgr2=0x7fb1f00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.715+0000 7fb1f6daf640 1 -- 172.21.15.43:0/668096279 shutdown_connections 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 -- 172.21.15.43:0/668096279 wait complete. 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 Processor -- start 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 -- start start 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f01023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 0x7fb1f01009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f010dc10 con 0x7fb1f0107c90 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f010da90 con 0x7fb1f0105360 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f6daf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f010dd90 con 0x7fb1f0102a30 2024-04-25T20:49:56.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.716+0000 7fb1f534c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f534c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36048/0 (socket says 172.21.15.43:36048) 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f534c640 1 -- 172.21.15.43:0/3351164288 learned_addr learned my addr 172.21.15.43:0/3351164288 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f01023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1effff640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 0x7fb1f01009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 msgr2=0x7fb1f01009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 0x7fb1f01009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 msgr2=0x7fb1f0100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 -- 172.21.15.43:0/3351164288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f01017b0 con 0x7fb1f0102a30 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f534c640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1effff640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 0x7fb1f01009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f4b4b640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f01023a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400e9f0 tx=0x7fb1e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400ccc0 con 0x7fb1f0102a30 2024-04-25T20:49:56.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1e4005020 con 0x7fb1f0102a30 2024-04-25T20:49:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f01a2370 con 0x7fb1f0102a30 2024-04-25T20:49:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.717+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40049c0 con 0x7fb1f0102a30 2024-04-25T20:49:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.718+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01a2840 con 0x7fb1f0102a30 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.719+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f004fce0 con 0x7fb1f0102a30 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.720+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fb1e40051d0 con 0x7fb1f0102a30 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.720+0000 7fb1edffb640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 0x7fb1e00a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.720+0000 7fb1effff640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 msgr2=0x7fb1e00a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.720+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fb1e40d04a0 con 0x7fb1f0102a30 2024-04-25T20:49:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.720+0000 7fb1effff640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 0x7fb1e00a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:49:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.725+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb1e409ce90 con 0x7fb1f0102a30 2024-04-25T20:49:56.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.921+0000 7fb1effff640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 msgr2=0x7fb1e00a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:56.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.921+0000 7fb1effff640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 0x7fb1e00a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:49:56.948 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.643+0000 7fec3638b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:56.948 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:56.946+0000 7fec3638b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:49:56.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:56.954+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb1f0062b50 con 0x7fb1f0102a30 2024-04-25T20:49:56.964 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:56.819+0000 7f8884d60200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T20:49:56.970 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.669+0000 7f0d99b7b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:57.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.009+0000 7fb1edffb640 1 -- 172.21.15.43:0/3351164288 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7fb1e409c790 con 0x7fb1f0102a30 2024-04-25T20:49:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 msgr2=0x7fb1e00a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 0x7fb1e00a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 msgr2=0x7fb1f01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f01023a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400e9f0 tx=0x7fb1e400eeb0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 shutdown_connections 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fb1e00a3ca0 0x7fb1e00a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0107c90 0x7fb1f0100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1f0105360 0x7fb1f01009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 --2- 172.21.15.43:0/3351164288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1f0102a30 0x7fb1f01023a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 >> 172.21.15.43:0/3351164288 conn(0x7fb1f00fc420 msgr2=0x7fb1f0103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 shutdown_connections 2024-04-25T20:49:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.012+0000 7fb1f6daf640 1 -- 172.21.15.43:0/3351164288 wait complete. 2024-04-25T20:49:57.024 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T20:49:57.036 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T20:49:57.057 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T20:49:57.057 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:49:57.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-25T20:49:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 -- 172.21.15.43:0/342751237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c1031c0 msgr2=0x7fc16c103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 --2- 172.21.15.43:0/342751237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c1031c0 0x7fc16c103640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc160009900 tx=0x7fc16002a410 comp rx=0 tx=0).stop 2024-04-25T20:49:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 -- 172.21.15.43:0/342751237 shutdown_connections 2024-04-25T20:49:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 --2- 172.21.15.43:0/342751237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c103b80 0x7fc16c10a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 --2- 172.21.15.43:0/342751237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c1031c0 0x7fc16c103640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 --2- 172.21.15.43:0/342751237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c101fd0 0x7fc16c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 -- 172.21.15.43:0/342751237 >> 172.21.15.43:0/342751237 conn(0x7fc16c0fd540 msgr2=0x7fc16c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 -- 172.21.15.43:0/342751237 shutdown_connections 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.163+0000 7fc171e13640 1 -- 172.21.15.43:0/342751237 wait complete. 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 Processor -- start 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 -- start start 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 0x7fc16c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c1031c0 0x7fc16c198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 0x7fc16c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10dc30 con 0x7fc16c103b80 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10dab0 con 0x7fc16c1031c0 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc171e13640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c10ddb0 con 0x7fc16c101fd0 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.164+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 0x7fc16c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:57.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 0x7fc16c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 0x7fc16c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36070/0 (socket says 172.21.15.43:36070) 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 0x7fc16c198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:38410/0 (socket says 172.21.15.43:38410) 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c1031c0 0x7fc16c198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 -- 172.21.15.43:0/2813371027 learned_addr learned my addr 172.21.15.43:0/2813371027 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 msgr2=0x7fc16c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 0x7fc16c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c1031c0 msgr2=0x7fc16c198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c1031c0 0x7fc16c198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c19fe70 con 0x7fc16c103b80 2024-04-25T20:49:57.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc16c101fd0 0x7fc16c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16affd640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc16c1031c0 0x7fc16c198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc16bfff640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 0x7fc16c19f800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc16400eb10 tx=0x7fc16400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164004b20 con 0x7fc16c103b80 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c0741e0 con 0x7fc16c103b80 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc164004cc0 con 0x7fc16c103b80 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164010720 con 0x7fc16c103b80 2024-04-25T20:49:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.165+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c074700 con 0x7fc16c103b80 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.166+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16c109290 con 0x7fc16c103b80 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.168+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fc164005020 con 0x7fc16c103b80 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.168+0000 7fc168ff9640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 0x7fc1540a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.169+0000 7fc16b7fe640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 msgr2=0x7fc1540a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.169+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8211+0+0 (secure 0 0 0) 0x7fc1640d09e0 con 0x7fc16c103b80 2024-04-25T20:49:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.169+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 0x7fc1540a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T20:49:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.173+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc16409d3d0 con 0x7fc16c103b80 2024-04-25T20:49:57.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:57 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3351164288' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:57 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:56.963+0000 7f8884d60200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T20:49:57.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:57.070+0000 7f8884d60200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T20:49:57.295 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:57.210+0000 7f8884d60200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T20:49:57.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:57 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3351164288' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:57 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.342 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:56.969+0000 7f0d99b7b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:49:57.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:57 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3351164288' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:57 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-25T20:49:57.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.370+0000 7fc16b7fe640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 msgr2=0x7fc1540a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:57.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.370+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 0x7fc1540a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T20:49:57.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.398+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc16c075bb0 con 0x7fc1540a3ca0 2024-04-25T20:49:57.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.771+0000 7fc16b7fe640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 msgr2=0x7fc1540a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.43:6800/3531160359 2024-04-25T20:49:57.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:57.771+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 0x7fc1540a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T20:49:57.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:57.538+0000 7f8884d60200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T20:49:57.841 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:57.550+0000 7fec3638b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:49:57.841 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 20:49:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z[35028]: 2024-04-25T20:49:57.766+0000 7fec3638b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:49:57.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:57.573+0000 7f0d99b7b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:49:57.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 20:49:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y[33748]: 2024-04-25T20:49:57.790+0000 7f0d99b7b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:49:58.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:58.023+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 20) ==== 138663+0+0 (secure 0 0 0) 0x7fc164099340 con 0x7fc16c103b80 2024-04-25T20:49:58.294 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.183+0000 7f8884d60200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: Standby manager daemon z restarted 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: Standby manager daemon z started 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: Standby manager daemon y restarted 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: Standby manager daemon y started 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:49:58.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:49:58.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-mon[29167]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: Standby manager daemon z restarted 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: Standby manager daemon z started 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: Standby manager daemon y restarted 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: Standby manager daemon y started 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:58 smithi195 ceph-mon[33250]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: Standby manager daemon z restarted 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: Standby manager daemon z started 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T20:49:58.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.195:0/762228458' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: Standby manager daemon y restarted 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: Standby manager daemon y started 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T20:49:58.344 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:58 smithi112 ceph-mon[32322]: from='mgr.? 172.21.15.112:0/2498533038' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T20:49:58.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:58.429+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7fc1640ce540 con 0x7fc16c103b80 2024-04-25T20:49:58.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:58.430+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 msgr2=0x7fc1540a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T20:49:58.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:58.430+0000 7fc168ff9640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/3531160359,v1:172.21.15.43:6801/3531160359] conn(0x7fc1540a3ca0 0x7fc1540a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:58.673 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.416+0000 7f8884d60200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.672+0000 7f87e6698700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.672+0000 7f87e6698700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.672+0000 7f87e6698700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.672+0000 7f87e6698700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.672+0000 7f87e6698700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.019 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.675+0000 7f87e4694700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.020 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.675+0000 7f87e4694700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.020 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.675+0000 7f87e4694700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.020 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.675+0000 7f87e4694700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.020 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:49:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:49:58.675+0000 7f87e4694700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: Active manager daemon x restarted 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: Activating manager daemon x 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: mgrmap e21: x(active, starting, since 0.0116803s), standbys: y, z 2024-04-25T20:49:59.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:49:59.296 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:49:59.297 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: Manager daemon x is now available 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:49:59.298 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:49:59 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: Active manager daemon x restarted 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: Activating manager daemon x 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: mgrmap e21: x(active, starting, since 0.0116803s), standbys: y, z 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:49:59.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:49:59.343 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:49:59.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: Manager daemon x is now available 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:49:59.345 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:49:59 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: Active manager daemon x restarted 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: Activating manager daemon x 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: mgrmap e21: x(active, starting, since 0.0116803s), standbys: y, z 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T20:49:59.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T20:49:59.347 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: Manager daemon x is now available 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:49:59.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T20:49:59.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:49:59 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T20:49:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.435+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mon.0 v2:172.21.15.43:3300/0 9 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fc1640780c0 con 0x7fc16c103b80 2024-04-25T20:49:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.435+0000 7fc168ff9640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc154035660 0x7fc154035a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:59.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.435+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc16c075bb0 con 0x7fc154035660 2024-04-25T20:49:59.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.438+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc154035660 0x7fc154035a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:59.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.444+0000 7fc16b7fe640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc154035660 0x7fc154035a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc16c103020 tx=0x7fc15c012040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:59.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.510+0000 7fc168ff9640 1 -- 172.21.15.43:0/2813371027 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc16c075bb0 con 0x7fc154035660 2024-04-25T20:49:59.511 INFO:teuthology.orchestra.run.smithi043.stdout:Schedule set for path / 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc154035660 msgr2=0x7fc154035a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc154035660 0x7fc154035a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc16c103020 tx=0x7fc15c012040 comp rx=0 tx=0).stop 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 msgr2=0x7fc16c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 --2- 172.21.15.43:0/2813371027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc16c103b80 0x7fc16c19f800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc16400eb10 tx=0x7fc16400c2d0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc16bfff640 1 -- 172.21.15.43:0/2813371027 reap_dead start 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 shutdown_connections 2024-04-25T20:49:59.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.512+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 >> 172.21.15.43:0/2813371027 conn(0x7fc16c0fd540 msgr2=0x7fc16c106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:59.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.513+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 shutdown_connections 2024-04-25T20:49:59.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.513+0000 7fc171e13640 1 -- 172.21.15.43:0/2813371027 wait complete. 2024-04-25T20:49:59.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-25T20:49:59.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.633+0000 7f470f8f5640 1 -- 172.21.15.43:0/1824122023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708105410 msgr2=0x7f4708107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.633+0000 7f470f8f5640 1 --2- 172.21.15.43:0/1824122023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708105410 0x7f4708107800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009900 tx=0x7f46f802a410 comp rx=0 tx=0).stop 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.633+0000 7f470f8f5640 1 -- 172.21.15.43:0/1824122023 shutdown_connections 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.633+0000 7f470f8f5640 1 --2- 172.21.15.43:0/1824122023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708107d40 0x7f470810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 --2- 172.21.15.43:0/1824122023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708105410 0x7f4708107800 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 --2- 172.21.15.43:0/1824122023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 0x7f4708104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- 172.21.15.43:0/1824122023 >> 172.21.15.43:0/1824122023 conn(0x7f47080fc4d0 msgr2=0x7f47080fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- 172.21.15.43:0/1824122023 shutdown_connections 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- 172.21.15.43:0/1824122023 wait complete. 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 Processor -- start 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- start start 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 0x7f470819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708105410 0x7f470819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:59.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f470810dc50 con 0x7f4708107d40 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f470810dad0 con 0x7f4708105410 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470f8f5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f470810ddd0 con 0x7f4708102ae0 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470de92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.634+0000 7f470de92640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36190/0 (socket says 172.21.15.43:36190) 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 -- 172.21.15.43:0/3388495087 learned_addr learned my addr 172.21.15.43:0/3388495087 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470d691640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 0x7f470819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470ce90640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708105410 0x7f470819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 -- 172.21.15.43:0/3388495087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 msgr2=0x7f470819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 0x7f470819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 -- 172.21.15.43:0/3388495087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708105410 msgr2=0x7f470819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708105410 0x7f470819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 -- 172.21.15.43:0/3388495087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47081a2000 con 0x7f4708107d40 2024-04-25T20:49:59.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470de92640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f470000cce0 tx=0x7f470000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:59.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470000f450 con 0x7f4708107d40 2024-04-25T20:49:59.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47081a22f0 con 0x7f4708107d40 2024-04-25T20:49:59.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f470000fac0 con 0x7f4708107d40 2024-04-25T20:49:59.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700018be0 con 0x7f4708107d40 2024-04-25T20:49:59.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.635+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47081a27c0 con 0x7f4708107d40 2024-04-25T20:49:59.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.636+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470804fce0 con 0x7f4708107d40 2024-04-25T20:49:59.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.637+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f470000fc70 con 0x7f4708107d40 2024-04-25T20:49:59.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.638+0000 7f46fe7fc640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 0x7f46f40a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:49:59.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.638+0000 7f470d691640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 0x7f46f40a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:49:59.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.638+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f47000d07f0 con 0x7f4708107d40 2024-04-25T20:49:59.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.639+0000 7f470d691640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 0x7f46f40a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4704009bd0 tx=0x7f4704005f90 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:49:59.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.643+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4700014030 con 0x7f4708107d40 2024-04-25T20:49:59.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.857+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4708062430 con 0x7f46f40a3a60 2024-04-25T20:49:59.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.915+0000 7f46fe7fc640 1 -- 172.21.15.43:0/3388495087 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4708062430 con 0x7f46f40a3a60 2024-04-25T20:49:59.916 INFO:teuthology.orchestra.run.smithi043.stdout:Retention added to path / 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 msgr2=0x7f46f40a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 0x7f46f40a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4704009bd0 tx=0x7f4704005f90 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 msgr2=0x7f47081a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f470000cce0 tx=0x7f470000a620 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 shutdown_connections 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f46f40a3a60 0x7f46f40a5f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4708107d40 0x7f47081a1990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4708105410 0x7f470819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 --2- 172.21.15.43:0/3388495087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4708102ae0 0x7f470819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:49:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 >> 172.21.15.43:0/3388495087 conn(0x7f47080fc4d0 msgr2=0x7f47081020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:49:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 shutdown_connections 2024-04-25T20:49:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:49:59.917+0000 7f470f8f5640 1 -- 172.21.15.43:0/3388495087 wait complete. 2024-04-25T20:49:59.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T20:50:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.031+0000 7fac42e49640 1 -- 172.21.15.43:0/2606126933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 msgr2=0x7fac3c107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.031+0000 7fac42e49640 1 --2- 172.21.15.43:0/2606126933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c107750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac28009900 tx=0x7fac2802a410 comp rx=0 tx=0).stop 2024-04-25T20:50:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- 172.21.15.43:0/2606126933 shutdown_connections 2024-04-25T20:50:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- 172.21.15.43:0/2606126933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 0x7fac3c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- 172.21.15.43:0/2606126933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c107750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- 172.21.15.43:0/2606126933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 0x7fac3c104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- 172.21.15.43:0/2606126933 >> 172.21.15.43:0/2606126933 conn(0x7fac3c0fc420 msgr2=0x7fac3c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- 172.21.15.43:0/2606126933 shutdown_connections 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- 172.21.15.43:0/2606126933 wait complete. 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 Processor -- start 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- start start 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 0x7fac3c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 0x7fac3c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c10dc10 con 0x7fac3c105360 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c10da90 con 0x7fac3c102a30 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac42e49640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c10dd90 con 0x7fac3c107c90 2024-04-25T20:50:00.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.032+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36208/0 (socket says 172.21.15.43:36208) 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 -- 172.21.15.43:0/1291456976 learned_addr learned my addr 172.21.15.43:0/1291456976 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac413e6640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 0x7fac3c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac40be5640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 0x7fac3c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 -- 172.21.15.43:0/1291456976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 msgr2=0x7fac3c19f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 0x7fac3c19f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 -- 172.21.15.43:0/1291456976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 msgr2=0x7fac3c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 0x7fac3c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 -- 172.21.15.43:0/1291456976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c19fe60 con 0x7fac3c105360 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac3bfff640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac28006010 tx=0x7fac280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2803f030 con 0x7fac3c105360 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac28003cd0 con 0x7fac3c105360 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c1a00f0 con 0x7fac3c105360 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.033+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28035070 con 0x7fac3c105360 2024-04-25T20:50:00.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.034+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c1a05e0 con 0x7fac3c105360 2024-04-25T20:50:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.035+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c0fdf10 con 0x7fac3c105360 2024-04-25T20:50:00.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.036+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fac28042030 con 0x7fac3c105360 2024-04-25T20:50:00.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.036+0000 7fac39ffb640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 0x7fac2c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.036+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fac280f04b0 con 0x7fac3c105360 2024-04-25T20:50:00.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.036+0000 7fac40be5640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 0x7fac2c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.037+0000 7fac40be5640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 0x7fac2c0a6070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac30009bd0 tx=0x7fac30005f90 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:00.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.041+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fac280bca40 con 0x7fac3c105360 2024-04-25T20:50:00.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.253+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fac3c062390 con 0x7fac2c0a3bb0 2024-04-25T20:50:00.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.261+0000 7fac39ffb640 1 -- 172.21.15.43:0/1291456976 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fac3c062390 con 0x7fac2c0a3bb0 2024-04-25T20:50:00.262 INFO:teuthology.orchestra.run.smithi043.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T20:49:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-25T20:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.263+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 msgr2=0x7fac2c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.263+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 0x7fac2c0a6070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac30009bd0 tx=0x7fac30005f90 comp rx=0 tx=0).stop 2024-04-25T20:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.263+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 msgr2=0x7fac3c198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.263+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac28006010 tx=0x7fac280042f0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 shutdown_connections 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fac2c0a3bb0 0x7fac2c0a6070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac3c107c90 0x7fac3c19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3c105360 0x7fac3c198780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 --2- 172.21.15.43:0/1291456976 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac3c102a30 0x7fac3c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 >> 172.21.15.43:0/1291456976 conn(0x7fac3c0fc420 msgr2=0x7fac3c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 shutdown_connections 2024-04-25T20:50:00.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.264+0000 7fac42e49640 1 -- 172.21.15.43:0/1291456976 wait complete. 2024-04-25T20:50:00.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T20:50:00.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 -- 172.21.15.43:0/2189513678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8101fc0 msgr2=0x7f6cc81023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 --2- 172.21.15.43:0/2189513678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8101fc0 0x7f6cc81023e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009900 tx=0x7f6cb802a410 comp rx=0 tx=0).stop 2024-04-25T20:50:00.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 -- 172.21.15.43:0/2189513678 shutdown_connections 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 --2- 172.21.15.43:0/2189513678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8103b70 0x7f6cc810a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 --2- 172.21.15.43:0/2189513678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 0x7f6cc8103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 --2- 172.21.15.43:0/2189513678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8101fc0 0x7f6cc81023e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.387+0000 7f6cccf95640 1 -- 172.21.15.43:0/2189513678 >> 172.21.15.43:0/2189513678 conn(0x7f6cc80fd510 msgr2=0x7f6cc80ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- 172.21.15.43:0/2189513678 shutdown_connections 2024-04-25T20:50:00.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- 172.21.15.43:0/2189513678 wait complete. 2024-04-25T20:50:00.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 Processor -- start 2024-04-25T20:50:00.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- start start 2024-04-25T20:50:00.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 0x7f6cc8075d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 0x7f6cc8074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc810dc20 con 0x7f6cc8103b70 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc810daa0 con 0x7f6cc8101fc0 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.388+0000 7f6cccf95640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc810dda0 con 0x7f6cc81031b0 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36224/0 (socket says 172.21.15.43:36224) 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 -- 172.21.15.43:0/3825833180 learned_addr learned my addr 172.21.15.43:0/3825833180 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc659c640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 0x7f6cc8075d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc5d9b640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 0x7f6cc8074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 -- 172.21.15.43:0/3825833180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 msgr2=0x7f6cc8074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 0x7f6cc8074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 -- 172.21.15.43:0/3825833180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 msgr2=0x7f6cc8075d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 0x7f6cc8075d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 -- 172.21.15.43:0/3825833180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc8075110 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc659c640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 0x7f6cc8075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cc6d9d640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000eb10 tx=0x7f6cc000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0004b20 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc81a2340 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6cc0004cc0 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0010720 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.389+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc81a2840 con 0x7f6cc8103b70 2024-04-25T20:50:00.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.390+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc81092e0 con 0x7f6cc8103b70 2024-04-25T20:50:00.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.392+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f6cc00108c0 con 0x7f6cc8103b70 2024-04-25T20:50:00.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.392+0000 7f6cb77fe640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 0x7f6cb00a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:00.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.393+0000 7f6cc659c640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 0x7f6cb00a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:00.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.393+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f6cc00d0910 con 0x7f6cc8103b70 2024-04-25T20:50:00.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.393+0000 7f6cc659c640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 0x7f6cb00a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009230 tx=0x7f6cb8031510 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:00.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.397+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6cc0053ff0 con 0x7f6cc8103b70 2024-04-25T20:50:00.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: [25/Apr/2024:20:49:59] ENGINE Bus STARTING 2024-04-25T20:50:00.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: [25/Apr/2024:20:49:59] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: mgrmap e22: x(active, since 1.01919s), standbys: y, z 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: [25/Apr/2024:20:49:59] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: [25/Apr/2024:20:49:59] ENGINE Bus STARTED 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-mon[29167]: overall HEALTH_OK 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: [25/Apr/2024:20:49:59] ENGINE Bus STARTING 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: [25/Apr/2024:20:49:59] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: mgrmap e22: x(active, since 1.01919s), standbys: y, z 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: [25/Apr/2024:20:49:59] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: [25/Apr/2024:20:49:59] ENGINE Bus STARTED 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.592 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:00 smithi195 ceph-mon[33250]: overall HEALTH_OK 2024-04-25T20:50:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.645+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6cc8062390 con 0x7f6cb00a3a60 2024-04-25T20:50:00.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.652+0000 7f6cb77fe640 1 -- 172.21.15.43:0/3825833180 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6cc8062390 con 0x7f6cb00a3a60 2024-04-25T20:50:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:/ 1m 6m3h 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 msgr2=0x7f6cb00a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 0x7f6cb00a5f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009230 tx=0x7f6cb8031510 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 msgr2=0x7f6cc8074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000eb10 tx=0x7f6cc000c2d0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 shutdown_connections 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cb00a3a60 0x7f6cb00a5f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cc8103b70 0x7f6cc8074880 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6cc81031b0 0x7f6cc8074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 --2- 172.21.15.43:0/3825833180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6cc8101fc0 0x7f6cc8075d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:00.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 >> 172.21.15.43:0/3825833180 conn(0x7f6cc80fd510 msgr2=0x7f6cc81064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:00.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 shutdown_connections 2024-04-25T20:50:00.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:00.654+0000 7f6cccf95640 1 -- 172.21.15.43:0/3825833180 wait complete. 2024-04-25T20:50:00.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-25T20:50:00.694 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-25T20:50:00.705 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-25T20:50:00.716 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:50:00.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-25T20:50:00.737 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T20:50:00.750 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T20:50:00.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:50:00.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: [25/Apr/2024:20:49:59] ENGINE Bus STARTING 2024-04-25T20:50:00.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: [25/Apr/2024:20:49:59] ENGINE Serving on http://172.21.15.43:8765 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: mgrmap e22: x(active, since 1.01919s), standbys: y, z 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: [25/Apr/2024:20:49:59] ENGINE Serving on https://172.21.15.43:7150 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: [25/Apr/2024:20:49:59] ENGINE Bus STARTED 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:00.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:00 smithi112 ceph-mon[32322]: overall HEALTH_OK 2024-04-25T20:50:01.019 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:01.288 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:50:00.924+0000 7f87c5216700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:50:01.288 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:50:00.925+0000 7f87c5216700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:50:01.288 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:50:00.925+0000 7f87c5216700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:50:01.288 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:50:00.925+0000 7f87c5216700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:50:01.288 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 20:50:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x[29402]: 2024-04-25T20:50:00.925+0000 7f87c5216700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:01 smithi043 ceph-mon[29167]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T20:50:01.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:01 smithi195 ceph-mon[33250]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:01.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:01 smithi112 ceph-mon[32322]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T20:50:02.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.761 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.762 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:02 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 -- 172.21.15.43:0/2567994289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c108a80 msgr2=0x7f3d8c108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 --2- 172.21.15.43:0/2567994289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c108a80 0x7f3d8c108e60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009990 tx=0x7f3d7c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 -- 172.21.15.43:0/2567994289 shutdown_connections 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 --2- 172.21.15.43:0/2567994289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 0x7f3d8c10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 --2- 172.21.15.43:0/2567994289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c108a80 0x7f3d8c108e60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 --2- 172.21.15.43:0/2567994289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c102af0 0x7f3d8c102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 -- 172.21.15.43:0/2567994289 >> 172.21.15.43:0/2567994289 conn(0x7f3d8c079ad0 msgr2=0x7f3d8c079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 -- 172.21.15.43:0/2567994289 shutdown_connections 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.753+0000 7f3d92893700 1 -- 172.21.15.43:0/2567994289 wait complete. 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.754+0000 7f3d92893700 1 Processor -- start 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.754+0000 7f3d92893700 1 -- start start 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 0x7f3d8c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:02.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 0x7f3d8c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c112dd0 con 0x7f3d8c102af0 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c112c50 con 0x7f3d8c108a80 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d92893700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c112f50 con 0x7f3d8c1034b0 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36292/0 (socket says 172.21.15.43:36292) 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 -- 172.21.15.43:0/1344031256 learned_addr learned my addr 172.21.15.43:0/1344031256 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d90e30700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 0x7f3d8c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8b7fe700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 0x7f3d8c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 -- 172.21.15.43:0/1344031256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 msgr2=0x7f3d8c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 0x7f3d8c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 -- 172.21.15.43:0/1344031256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 msgr2=0x7f3d8c19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 0x7f3d8c19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d8bfff700 1 -- 172.21.15.43:0/1344031256 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c19e210 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.755+0000 7f3d90e30700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 0x7f3d8c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d8bfff700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c027070 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d7c022470 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c017650 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c19e4a0 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.756+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c074c70 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.757+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c1041b0 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.759+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 23) ==== 138766+0+0 (secure 0 0 0) 0x7f3d7c02a070 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.760+0000 7f3d897fa700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 0x7f3d740a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.760+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f3d7c0d16a0 con 0x7f3d8c102af0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.760+0000 7f3d8b7fe700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 0x7f3d740a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.760+0000 7f3d8b7fe700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 0x7f3d740a6270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c07a0d0 tx=0x7f3d80012040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:02.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.764+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d7c013070 con 0x7f3d8c102af0 2024-04-25T20:50:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:02 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:02.843 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.844 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:02 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:02.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.974+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d8c19a560 con 0x7f3d740a3db0 2024-04-25T20:50:02.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.982+0000 7f3d897fa700 1 -- 172.21.15.43:0/1344031256 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258073 (secure 0 0 0) 0x7f3d8c19a560 con 0x7f3d740a3db0 2024-04-25T20:50:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:02.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 msgr2=0x7f3d740a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:02.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 0x7f3d740a6270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c07a0d0 tx=0x7f3d80012040 comp rx=0 tx=0).stop 2024-04-25T20:50:02.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 msgr2=0x7f3d8c199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0047b0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 shutdown_connections 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f3d740a3db0 0x7f3d740a6270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3d8c108a80 0x7f3d8c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d8c102af0 0x7f3d8c199200 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 --2- 172.21.15.43:0/1344031256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d8c1034b0 0x7f3d8c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 >> 172.21.15.43:0/1344031256 conn(0x7f3d8c079ad0 msgr2=0x7f3d8c1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 shutdown_connections 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:02.985+0000 7f3d92893700 1 -- 172.21.15.43:0/1344031256 wait complete. 2024-04-25T20:50:02.989 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:50:03.705 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T20:50:03.705 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:50:03.706 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:03.707 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:03 smithi043 ceph-mon[29167]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T20:50:03.736 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-25T20:50:02.441648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1198058,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2213,"num_read_kb":1281,"num_write":569,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390816,"kb_used_data":12516,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551008,"statfs":{"total":1151940427776,"available":1151540232192,"internally_reserved":0,"allocated":12816384,"data_stored":9466266,"data_compressed":218575,"data_compressed_allocated":286720,"data_compressed_original":3424256,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.991121"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517492+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:49:58.517492+0000","last_peered":"2024-04-25T20:49:58.517492+0000","last_clean":"2024-04-25T20:49:58.517492+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:49:58.517492+0000","last_undegraded":"2024-04-25T20:49:58.517492+0000","last_fullsized":"2024-04-25T20:49:58.517492+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516865+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:49:58.516865+0000","last_peered":"2024-04-25T20:49:58.516865+0000","last_clean":"2024-04-25T20:49:58.516865+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:49:58.516865+0000","last_undegraded":"2024-04-25T20:49:58.516865+0000","last_fullsized":"2024-04-25T20:49:58.516865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516579+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:49:58.516579+0000","last_peered":"2024-04-25T20:49:58.516579+0000","last_clean":"2024-04-25T20:49:58.516579+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:49:58.516579+0000","last_undegraded":"2024-04-25T20:49:58.516579+0000","last_fullsized":"2024-04-25T20:49:58.516579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429384+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:49:58.429384+0000","last_peered":"2024-04-25T20:49:58.429384+0000","last_clean":"2024-04-25T20:49:58.429384+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:49:58.429384+0000","last_undegraded":"2024-04-25T20:49:58.429384+0000","last_fullsized":"2024-04-25T20:49:58.429384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426105+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:49:58.426105+0000","last_peered":"2024-04-25T20:49:58.426105+0000","last_clean":"2024-04-25T20:49:58.426105+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:49:58.426105+0000","last_undegraded":"2024-04-25T20:49:58.426105+0000","last_fullsized":"2024-04-25T20:49:58.426105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489176+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:49:58.489176+0000","last_peered":"2024-04-25T20:49:58.489176+0000","last_clean":"2024-04-25T20:49:58.489176+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:49:58.489176+0000","last_undegraded":"2024-04-25T20:49:58.489176+0000","last_fullsized":"2024-04-25T20:49:58.489176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526625+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:49:58.526625+0000","last_peered":"2024-04-25T20:49:58.526625+0000","last_clean":"2024-04-25T20:49:58.526625+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:49:58.526625+0000","last_undegraded":"2024-04-25T20:49:58.526625+0000","last_fullsized":"2024-04-25T20:49:58.526625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537928+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:49:58.537928+0000","last_peered":"2024-04-25T20:49:58.537928+0000","last_clean":"2024-04-25T20:49:58.537928+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:49:58.537928+0000","last_undegraded":"2024-04-25T20:49:58.537928+0000","last_fullsized":"2024-04-25T20:49:58.537928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.536142+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:49:58.536142+0000","last_peered":"2024-04-25T20:49:58.536142+0000","last_clean":"2024-04-25T20:49:58.536142+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:49:58.536142+0000","last_undegraded":"2024-04-25T20:49:58.536142+0000","last_fullsized":"2024-04-25T20:49:58.536142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489490+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:49:58.489490+0000","last_peered":"2024-04-25T20:49:58.489490+0000","last_clean":"2024-04-25T20:49:58.489490+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:49:58.489490+0000","last_undegraded":"2024-04-25T20:49:58.489490+0000","last_fullsized":"2024-04-25T20:49:58.489490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429359+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:49:58.429359+0000","last_peered":"2024-04-25T20:49:58.429359+0000","last_clean":"2024-04-25T20:49:58.429359+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:49:58.429359+0000","last_undegraded":"2024-04-25T20:49:58.429359+0000","last_fullsized":"2024-04-25T20:49:58.429359+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680883+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:49:58.680883+0000","last_peered":"2024-04-25T20:49:58.680883+0000","last_clean":"2024-04-25T20:49:58.680883+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:49:58.680883+0000","last_undegraded":"2024-04-25T20:49:58.680883+0000","last_fullsized":"2024-04-25T20:49:58.680883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516328+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:49:58.516328+0000","last_peered":"2024-04-25T20:49:58.516328+0000","last_clean":"2024-04-25T20:49:58.516328+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:49:58.516328+0000","last_undegraded":"2024-04-25T20:49:58.516328+0000","last_fullsized":"2024-04-25T20:49:58.516328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516217+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:49:58.516217+0000","last_peered":"2024-04-25T20:49:58.516217+0000","last_clean":"2024-04-25T20:49:58.516217+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:49:58.516217+0000","last_undegraded":"2024-04-25T20:49:58.516217+0000","last_fullsized":"2024-04-25T20:49:58.516217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537480+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:49:58.537480+0000","last_peered":"2024-04-25T20:49:58.537480+0000","last_clean":"2024-04-25T20:49:58.537480+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:49:58.537480+0000","last_undegraded":"2024-04-25T20:49:58.537480+0000","last_fullsized":"2024-04-25T20:49:58.537480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517588+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:49:58.517588+0000","last_peered":"2024-04-25T20:49:58.517588+0000","last_clean":"2024-04-25T20:49:58.517588+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:49:58.517588+0000","last_undegraded":"2024-04-25T20:49:58.517588+0000","last_fullsized":"2024-04-25T20:49:58.517588+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424584+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:49:58.424584+0000","last_peered":"2024-04-25T20:49:58.424584+0000","last_clean":"2024-04-25T20:49:58.424584+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:49:58.424584+0000","last_undegraded":"2024-04-25T20:49:58.424584+0000","last_fullsized":"2024-04-25T20:49:58.424584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680624+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:49:58.680624+0000","last_peered":"2024-04-25T20:49:58.680624+0000","last_clean":"2024-04-25T20:49:58.680624+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:49:58.680624+0000","last_undegraded":"2024-04-25T20:49:58.680624+0000","last_fullsized":"2024-04-25T20:49:58.680624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"92'15","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681032+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:49:58.681032+0000","last_peered":"2024-04-25T20:49:58.681032+0000","last_clean":"2024-04-25T20:49:58.681032+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:49:58.681032+0000","last_undegraded":"2024-04-25T20:49:58.681032+0000","last_fullsized":"2024-04-25T20:49:58.681032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527400+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:49:58.527400+0000","last_peered":"2024-04-25T20:49:58.527400+0000","last_clean":"2024-04-25T20:49:58.527400+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:49:58.527400+0000","last_undegraded":"2024-04-25T20:49:58.527400+0000","last_fullsized":"2024-04-25T20:49:58.527400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527611+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:49:58.527611+0000","last_peered":"2024-04-25T20:49:58.527611+0000","last_clean":"2024-04-25T20:49:58.527611+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:49:58.527611+0000","last_undegraded":"2024-04-25T20:49:58.527611+0000","last_fullsized":"2024-04-25T20:49:58.527611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517148+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:49:58.517148+0000","last_peered":"2024-04-25T20:49:58.517148+0000","last_clean":"2024-04-25T20:49:58.517148+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:49:58.517148+0000","last_undegraded":"2024-04-25T20:49:58.517148+0000","last_fullsized":"2024-04-25T20:49:58.517148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426504+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:49:58.426504+0000","last_peered":"2024-04-25T20:49:58.426504+0000","last_clean":"2024-04-25T20:49:58.426504+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:49:58.426504+0000","last_undegraded":"2024-04-25T20:49:58.426504+0000","last_fullsized":"2024-04-25T20:49:58.426504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537574+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:49:58.537574+0000","last_peered":"2024-04-25T20:49:58.537574+0000","last_clean":"2024-04-25T20:49:58.537574+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:49:58.537574+0000","last_undegraded":"2024-04-25T20:49:58.537574+0000","last_fullsized":"2024-04-25T20:49:58.537574+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426346+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:49:58.426346+0000","last_peered":"2024-04-25T20:49:58.426346+0000","last_clean":"2024-04-25T20:49:58.426346+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:49:58.426346+0000","last_undegraded":"2024-04-25T20:49:58.426346+0000","last_fullsized":"2024-04-25T20:49:58.426346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533330+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:49:58.533330+0000","last_peered":"2024-04-25T20:49:58.533330+0000","last_clean":"2024-04-25T20:49:58.533330+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:49:58.533330+0000","last_undegraded":"2024-04-25T20:49:58.533330+0000","last_fullsized":"2024-04-25T20:49:58.533330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.782929+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:49:58.782929+0000","last_peered":"2024-04-25T20:49:58.782929+0000","last_clean":"2024-04-25T20:49:58.782929+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:49:58.782929+0000","last_undegraded":"2024-04-25T20:49:58.782929+0000","last_fullsized":"2024-04-25T20:49:58.782929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426009+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:49:58.426009+0000","last_peered":"2024-04-25T20:49:58.426009+0000","last_clean":"2024-04-25T20:49:58.426009+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:49:58.426009+0000","last_undegraded":"2024-04-25T20:49:58.426009+0000","last_fullsized":"2024-04-25T20:49:58.426009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535739+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:49:58.535739+0000","last_peered":"2024-04-25T20:49:58.535739+0000","last_clean":"2024-04-25T20:49:58.535739+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:49:58.535739+0000","last_undegraded":"2024-04-25T20:49:58.535739+0000","last_fullsized":"2024-04-25T20:49:58.535739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533143+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:49:58.533143+0000","last_peered":"2024-04-25T20:49:58.533143+0000","last_clean":"2024-04-25T20:49:58.533143+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:49:58.533143+0000","last_undegraded":"2024-04-25T20:49:58.533143+0000","last_fullsized":"2024-04-25T20:49:58.533143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681133+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:49:58.681133+0000","last_peered":"2024-04-25T20:49:58.681133+0000","last_clean":"2024-04-25T20:49:58.681133+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:49:58.681133+0000","last_undegraded":"2024-04-25T20:49:58.681133+0000","last_fullsized":"2024-04-25T20:49:58.681133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526715+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:49:58.526715+0000","last_peered":"2024-04-25T20:49:58.526715+0000","last_clean":"2024-04-25T20:49:58.526715+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:49:58.526715+0000","last_undegraded":"2024-04-25T20:49:58.526715+0000","last_fullsized":"2024-04-25T20:49:58.526715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.532968+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:49:58.532968+0000","last_peered":"2024-04-25T20:49:58.532968+0000","last_clean":"2024-04-25T20:49:58.532968+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:49:58.532968+0000","last_undegraded":"2024-04-25T20:49:58.532968+0000","last_fullsized":"2024-04-25T20:49:58.532968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424378+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:49:58.424378+0000","last_peered":"2024-04-25T20:49:58.424378+0000","last_clean":"2024-04-25T20:49:58.424378+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:49:58.424378+0000","last_undegraded":"2024-04-25T20:49:58.424378+0000","last_fullsized":"2024-04-25T20:49:58.424378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'8","reported_seq":423,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.782408+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:49:58.782408+0000","last_peered":"2024-04-25T20:49:58.782408+0000","last_clean":"2024-04-25T20:49:58.782408+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:49:58.782408+0000","last_undegraded":"2024-04-25T20:49:58.782408+0000","last_fullsized":"2024-04-25T20:49:58.782408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":386,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537888+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:49:58.537888+0000","last_peered":"2024-04-25T20:49:58.537888+0000","last_clean":"2024-04-25T20:49:58.537888+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:49:58.537888+0000","last_undegraded":"2024-04-25T20:49:58.537888+0000","last_fullsized":"2024-04-25T20:49:58.537888+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489558+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:49:58.489558+0000","last_peered":"2024-04-25T20:49:58.489558+0000","last_clean":"2024-04-25T20:49:58.489558+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:49:58.489558+0000","last_undegraded":"2024-04-25T20:49:58.489558+0000","last_fullsized":"2024-04-25T20:49:58.489558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517145+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:49:58.517145+0000","last_peered":"2024-04-25T20:49:58.517145+0000","last_clean":"2024-04-25T20:49:58.517145+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:49:58.517145+0000","last_undegraded":"2024-04-25T20:49:58.517145+0000","last_fullsized":"2024-04-25T20:49:58.517145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533409+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:49:58.533409+0000","last_peered":"2024-04-25T20:49:58.533409+0000","last_clean":"2024-04-25T20:49:58.533409+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:49:58.533409+0000","last_undegraded":"2024-04-25T20:49:58.533409+0000","last_fullsized":"2024-04-25T20:49:58.533409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537703+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:49:58.537703+0000","last_peered":"2024-04-25T20:49:58.537703+0000","last_clean":"2024-04-25T20:49:58.537703+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:49:58.537703+0000","last_undegraded":"2024-04-25T20:49:58.537703+0000","last_fullsized":"2024-04-25T20:49:58.537703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'41","reported_seq":470,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.779109+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:49:58.779109+0000","last_peered":"2024-04-25T20:49:58.779109+0000","last_clean":"2024-04-25T20:49:58.779109+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:49:58.779109+0000","last_undegraded":"2024-04-25T20:49:58.779109+0000","last_fullsized":"2024-04-25T20:49:58.779109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71436,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":270,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426314+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:49:58.426314+0000","last_peered":"2024-04-25T20:49:58.426314+0000","last_clean":"2024-04-25T20:49:58.426314+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:49:58.426314+0000","last_undegraded":"2024-04-25T20:49:58.426314+0000","last_fullsized":"2024-04-25T20:49:58.426314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680493+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:49:58.680493+0000","last_peered":"2024-04-25T20:49:58.680493+0000","last_clean":"2024-04-25T20:49:58.680493+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:49:58.680493+0000","last_undegraded":"2024-04-25T20:49:58.680493+0000","last_fullsized":"2024-04-25T20:49:58.680493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680951+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:49:58.680951+0000","last_peered":"2024-04-25T20:49:58.680951+0000","last_clean":"2024-04-25T20:49:58.680951+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:49:58.680951+0000","last_undegraded":"2024-04-25T20:49:58.680951+0000","last_fullsized":"2024-04-25T20:49:58.680951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533011+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:49:58.533011+0000","last_peered":"2024-04-25T20:49:58.533011+0000","last_clean":"2024-04-25T20:49:58.533011+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:49:58.533011+0000","last_undegraded":"2024-04-25T20:49:58.533011+0000","last_fullsized":"2024-04-25T20:49:58.533011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489352+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:49:58.489352+0000","last_peered":"2024-04-25T20:49:58.489352+0000","last_clean":"2024-04-25T20:49:58.489352+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:49:58.489352+0000","last_undegraded":"2024-04-25T20:49:58.489352+0000","last_fullsized":"2024-04-25T20:49:58.489352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'8","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.864719+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:49:58.864719+0000","last_peered":"2024-04-25T20:49:58.864719+0000","last_clean":"2024-04-25T20:49:58.864719+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:49:58.864719+0000","last_undegraded":"2024-04-25T20:49:58.864719+0000","last_fullsized":"2024-04-25T20:49:58.864719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489112+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:49:58.489112+0000","last_peered":"2024-04-25T20:49:58.489112+0000","last_clean":"2024-04-25T20:49:58.489112+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:49:58.489112+0000","last_undegraded":"2024-04-25T20:49:58.489112+0000","last_fullsized":"2024-04-25T20:49:58.489112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533010+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:49:58.533010+0000","last_peered":"2024-04-25T20:49:58.533010+0000","last_clean":"2024-04-25T20:49:58.533010+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:49:58.533010+0000","last_undegraded":"2024-04-25T20:49:58.533010+0000","last_fullsized":"2024-04-25T20:49:58.533010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426464+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:49:58.426464+0000","last_peered":"2024-04-25T20:49:58.426464+0000","last_clean":"2024-04-25T20:49:58.426464+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:49:58.426464+0000","last_undegraded":"2024-04-25T20:49:58.426464+0000","last_fullsized":"2024-04-25T20:49:58.426464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517414+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:49:58.517414+0000","last_peered":"2024-04-25T20:49:58.517414+0000","last_clean":"2024-04-25T20:49:58.517414+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:49:58.517414+0000","last_undegraded":"2024-04-25T20:49:58.517414+0000","last_fullsized":"2024-04-25T20:49:58.517414+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424477+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:49:58.424477+0000","last_peered":"2024-04-25T20:49:58.424477+0000","last_clean":"2024-04-25T20:49:58.424477+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:49:58.424477+0000","last_undegraded":"2024-04-25T20:49:58.424477+0000","last_fullsized":"2024-04-25T20:49:58.424477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535918+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:49:58.535918+0000","last_peered":"2024-04-25T20:49:58.535918+0000","last_clean":"2024-04-25T20:49:58.535918+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:49:58.535918+0000","last_undegraded":"2024-04-25T20:49:58.535918+0000","last_fullsized":"2024-04-25T20:49:58.535918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'9","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.786112+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:49:58.786112+0000","last_peered":"2024-04-25T20:49:58.786112+0000","last_clean":"2024-04-25T20:49:58.786112+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:49:58.786112+0000","last_undegraded":"2024-04-25T20:49:58.786112+0000","last_fullsized":"2024-04-25T20:49:58.786112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":197,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424272+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:49:58.424272+0000","last_peered":"2024-04-25T20:49:58.424272+0000","last_clean":"2024-04-25T20:49:58.424272+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:49:58.424272+0000","last_undegraded":"2024-04-25T20:49:58.424272+0000","last_fullsized":"2024-04-25T20:49:58.424272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"92'7","reported_seq":230,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.685590+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:49:58.685590+0000","last_peered":"2024-04-25T20:49:58.685590+0000","last_clean":"2024-04-25T20:49:58.685590+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:49:58.685590+0000","last_undegraded":"2024-04-25T20:49:58.685590+0000","last_fullsized":"2024-04-25T20:49:58.685590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527251+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:49:58.527251+0000","last_peered":"2024-04-25T20:49:58.527251+0000","last_clean":"2024-04-25T20:49:58.527251+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:49:58.527251+0000","last_undegraded":"2024-04-25T20:49:58.527251+0000","last_fullsized":"2024-04-25T20:49:58.527251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429311+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:49:58.429311+0000","last_peered":"2024-04-25T20:49:58.429311+0000","last_clean":"2024-04-25T20:49:58.429311+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:49:58.429311+0000","last_undegraded":"2024-04-25T20:49:58.429311+0000","last_fullsized":"2024-04-25T20:49:58.429311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489212+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:49:58.489212+0000","last_peered":"2024-04-25T20:49:58.489212+0000","last_clean":"2024-04-25T20:49:58.489212+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:49:58.489212+0000","last_undegraded":"2024-04-25T20:49:58.489212+0000","last_fullsized":"2024-04-25T20:49:58.489212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680709+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:49:58.680709+0000","last_peered":"2024-04-25T20:49:58.680709+0000","last_clean":"2024-04-25T20:49:58.680709+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:49:58.680709+0000","last_undegraded":"2024-04-25T20:49:58.680709+0000","last_fullsized":"2024-04-25T20:49:58.680709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489331+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:49:58.489331+0000","last_peered":"2024-04-25T20:49:58.489331+0000","last_clean":"2024-04-25T20:49:58.489331+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:49:58.489331+0000","last_undegraded":"2024-04-25T20:49:58.489331+0000","last_fullsized":"2024-04-25T20:49:58.489331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426353+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:49:58.426353+0000","last_peered":"2024-04-25T20:49:58.426353+0000","last_clean":"2024-04-25T20:49:58.426353+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:49:58.426353+0000","last_undegraded":"2024-04-25T20:49:58.426353+0000","last_fullsized":"2024-04-25T20:49:58.426353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681434+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:49:58.681434+0000","last_peered":"2024-04-25T20:49:58.681434+0000","last_clean":"2024-04-25T20:49:58.681434+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:49:58.681434+0000","last_undegraded":"2024-04-25T20:49:58.681434+0000","last_fullsized":"2024-04-25T20:49:58.681434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'50","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.639909+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:49:58.639909+0000","last_peered":"2024-04-25T20:49:58.639909+0000","last_clean":"2024-04-25T20:49:58.639909+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:49:58.639909+0000","last_undegraded":"2024-04-25T20:49:58.639909+0000","last_fullsized":"2024-04-25T20:49:58.639909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527081+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:49:58.527081+0000","last_peered":"2024-04-25T20:49:58.527081+0000","last_clean":"2024-04-25T20:49:58.527081+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:49:58.527081+0000","last_undegraded":"2024-04-25T20:49:58.527081+0000","last_fullsized":"2024-04-25T20:49:58.527081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429515+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:49:58.429515+0000","last_peered":"2024-04-25T20:49:58.429515+0000","last_clean":"2024-04-25T20:49:58.429515+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:49:58.429515+0000","last_undegraded":"2024-04-25T20:49:58.429515+0000","last_fullsized":"2024-04-25T20:49:58.429515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516900+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:49:58.516900+0000","last_peered":"2024-04-25T20:49:58.516900+0000","last_clean":"2024-04-25T20:49:58.516900+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:49:58.516900+0000","last_undegraded":"2024-04-25T20:49:58.516900+0000","last_fullsized":"2024-04-25T20:49:58.516900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537491+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:49:58.537491+0000","last_peered":"2024-04-25T20:49:58.537491+0000","last_clean":"2024-04-25T20:49:58.537491+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:49:58.537491+0000","last_undegraded":"2024-04-25T20:49:58.537491+0000","last_fullsized":"2024-04-25T20:49:58.537491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526907+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:49:58.526907+0000","last_peered":"2024-04-25T20:49:58.526907+0000","last_clean":"2024-04-25T20:49:58.526907+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:49:58.526907+0000","last_undegraded":"2024-04-25T20:49:58.526907+0000","last_fullsized":"2024-04-25T20:49:58.526907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517181+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:49:58.517181+0000","last_peered":"2024-04-25T20:49:58.517181+0000","last_clean":"2024-04-25T20:49:58.517181+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:49:58.517181+0000","last_undegraded":"2024-04-25T20:49:58.517181+0000","last_fullsized":"2024-04-25T20:49:58.517181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680259+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:49:58.680259+0000","last_peered":"2024-04-25T20:49:58.680259+0000","last_clean":"2024-04-25T20:49:58.680259+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:49:58.680259+0000","last_undegraded":"2024-04-25T20:49:58.680259+0000","last_fullsized":"2024-04-25T20:49:58.680259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526892+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:49:58.526892+0000","last_peered":"2024-04-25T20:49:58.526892+0000","last_clean":"2024-04-25T20:49:58.526892+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:49:58.526892+0000","last_undegraded":"2024-04-25T20:49:58.526892+0000","last_fullsized":"2024-04-25T20:49:58.526892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517138+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:49:58.517138+0000","last_peered":"2024-04-25T20:49:58.517138+0000","last_clean":"2024-04-25T20:49:58.517138+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:49:58.517138+0000","last_undegraded":"2024-04-25T20:49:58.517138+0000","last_fullsized":"2024-04-25T20:49:58.517138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489363+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:49:58.489363+0000","last_peered":"2024-04-25T20:49:58.489363+0000","last_clean":"2024-04-25T20:49:58.489363+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:49:58.489363+0000","last_undegraded":"2024-04-25T20:49:58.489363+0000","last_fullsized":"2024-04-25T20:49:58.489363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'8","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.786331+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:49:58.786331+0000","last_peered":"2024-04-25T20:49:58.786331+0000","last_clean":"2024-04-25T20:49:58.786331+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:49:58.786331+0000","last_undegraded":"2024-04-25T20:49:58.786331+0000","last_fullsized":"2024-04-25T20:49:58.786331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489597+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:49:58.489597+0000","last_peered":"2024-04-25T20:49:58.489597+0000","last_clean":"2024-04-25T20:49:58.489597+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:49:58.489597+0000","last_undegraded":"2024-04-25T20:49:58.489597+0000","last_fullsized":"2024-04-25T20:49:58.489597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.637533+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:49:58.637533+0000","last_peered":"2024-04-25T20:49:58.637533+0000","last_clean":"2024-04-25T20:49:58.637533+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:49:58.637533+0000","last_undegraded":"2024-04-25T20:49:58.637533+0000","last_fullsized":"2024-04-25T20:49:58.637533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489311+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:49:58.489311+0000","last_peered":"2024-04-25T20:49:58.489311+0000","last_clean":"2024-04-25T20:49:58.489311+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:49:58.489311+0000","last_undegraded":"2024-04-25T20:49:58.489311+0000","last_fullsized":"2024-04-25T20:49:58.489311+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681526+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:49:58.681526+0000","last_peered":"2024-04-25T20:49:58.681526+0000","last_clean":"2024-04-25T20:49:58.681526+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:49:58.681526+0000","last_undegraded":"2024-04-25T20:49:58.681526+0000","last_fullsized":"2024-04-25T20:49:58.681526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489644+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:49:58.489644+0000","last_peered":"2024-04-25T20:49:58.489644+0000","last_clean":"2024-04-25T20:49:58.489644+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:49:58.489644+0000","last_undegraded":"2024-04-25T20:49:58.489644+0000","last_fullsized":"2024-04-25T20:49:58.489644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517178+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:49:58.517178+0000","last_peered":"2024-04-25T20:49:58.517178+0000","last_clean":"2024-04-25T20:49:58.517178+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:49:58.517178+0000","last_undegraded":"2024-04-25T20:49:58.517178+0000","last_fullsized":"2024-04-25T20:49:58.517178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680328+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:49:58.680328+0000","last_peered":"2024-04-25T20:49:58.680328+0000","last_clean":"2024-04-25T20:49:58.680328+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:49:58.680328+0000","last_undegraded":"2024-04-25T20:49:58.680328+0000","last_fullsized":"2024-04-25T20:49:58.680328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680241+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:49:58.680241+0000","last_peered":"2024-04-25T20:49:58.680241+0000","last_clean":"2024-04-25T20:49:58.680241+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:49:58.680241+0000","last_undegraded":"2024-04-25T20:49:58.680241+0000","last_fullsized":"2024-04-25T20:49:58.680241+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516505+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:49:58.516505+0000","last_peered":"2024-04-25T20:49:58.516505+0000","last_clean":"2024-04-25T20:49:58.516505+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:49:58.516505+0000","last_undegraded":"2024-04-25T20:49:58.516505+0000","last_fullsized":"2024-04-25T20:49:58.516505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681247+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:49:58.681247+0000","last_peered":"2024-04-25T20:49:58.681247+0000","last_clean":"2024-04-25T20:49:58.681247+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:49:58.681247+0000","last_undegraded":"2024-04-25T20:49:58.681247+0000","last_fullsized":"2024-04-25T20:49:58.681247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517378+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:49:58.517378+0000","last_peered":"2024-04-25T20:49:58.517378+0000","last_clean":"2024-04-25T20:49:58.517378+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:49:58.517378+0000","last_undegraded":"2024-04-25T20:49:58.517378+0000","last_fullsized":"2024-04-25T20:49:58.517378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680645+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:49:58.680645+0000","last_peered":"2024-04-25T20:49:58.680645+0000","last_clean":"2024-04-25T20:49:58.680645+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:49:58.680645+0000","last_undegraded":"2024-04-25T20:49:58.680645+0000","last_fullsized":"2024-04-25T20:49:58.680645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526828+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:49:58.526828+0000","last_peered":"2024-04-25T20:49:58.526828+0000","last_clean":"2024-04-25T20:49:58.526828+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:49:58.526828+0000","last_undegraded":"2024-04-25T20:49:58.526828+0000","last_fullsized":"2024-04-25T20:49:58.526828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680693+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:49:58.680693+0000","last_peered":"2024-04-25T20:49:58.680693+0000","last_clean":"2024-04-25T20:49:58.680693+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:49:58.680693+0000","last_undegraded":"2024-04-25T20:49:58.680693+0000","last_fullsized":"2024-04-25T20:49:58.680693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526808+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:49:58.526808+0000","last_peered":"2024-04-25T20:49:58.526808+0000","last_clean":"2024-04-25T20:49:58.526808+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:49:58.526808+0000","last_undegraded":"2024-04-25T20:49:58.526808+0000","last_fullsized":"2024-04-25T20:49:58.526808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537617+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:49:58.537617+0000","last_peered":"2024-04-25T20:49:58.537617+0000","last_clean":"2024-04-25T20:49:58.537617+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:49:58.537617+0000","last_undegraded":"2024-04-25T20:49:58.537617+0000","last_fullsized":"2024-04-25T20:49:58.537617+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681231+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:49:58.681231+0000","last_peered":"2024-04-25T20:49:58.681231+0000","last_clean":"2024-04-25T20:49:58.681231+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:49:58.681231+0000","last_undegraded":"2024-04-25T20:49:58.681231+0000","last_fullsized":"2024-04-25T20:49:58.681231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517186+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:49:58.517186+0000","last_peered":"2024-04-25T20:49:58.517186+0000","last_clean":"2024-04-25T20:49:58.517186+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:49:58.517186+0000","last_undegraded":"2024-04-25T20:49:58.517186+0000","last_fullsized":"2024-04-25T20:49:58.517186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":607456,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2077,"num_read_kb":1162,"num_write":386,"num_write_kb":1480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1822368,"data_compressed":81372,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1007616,"data_stored":493009,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712812,"statfs":{"total":95995035648,"available":95961919488,"internally_reserved":0,"allocated":1191936,"data_stored":1287465,"data_compressed":46991,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":885623,"data_compressed":22041,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037833,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1052672,"data_stored":886001,"data_compressed":22041,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1081344,"data_stored":1088771,"data_compressed":39013,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462995,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":564223,"data_compressed":4717,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738482,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1036288,"data_stored":494386,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411433,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":556356,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149794,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":1016765,"data_compressed":28197,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888158,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":492908,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724633,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":1217030,"data_compressed":45068,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":74502,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":75953,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":136042,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":205695,"data_compressed":7978,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:50:03.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:50:03.994 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:04.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:03 smithi195 ceph-mon[33250]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi043:/etc/ceph/ceph.conf 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi112:/etc/ceph/ceph.conf 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi195:/etc/ceph/ceph.conf 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T20:50:04.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:04.096 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:03 smithi112 ceph-mon[32322]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T20:50:05.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:50:05.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:05.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:05.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:50:05.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi043:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: Updating smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:50:05.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:50:05.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 -- 172.21.15.43:0/1184810736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870102ac0 msgr2=0x7f7870102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 --2- 172.21.15.43:0/1184810736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870102ac0 0x7f7870102f40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f785c009990 tx=0x7f785c009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 -- 172.21.15.43:0/1184810736 shutdown_connections 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 --2- 172.21.15.43:0/1184810736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 0x7f787010f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 --2- 172.21.15.43:0/1184810736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870108a70 0x7f7870108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 --2- 172.21.15.43:0/1184810736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870102ac0 0x7f7870102f40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 -- 172.21.15.43:0/1184810736 >> 172.21.15.43:0/1184810736 conn(0x7f7870079bb0 msgr2=0x7f7870079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 -- 172.21.15.43:0/1184810736 shutdown_connections 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.733+0000 7f7876bba700 1 -- 172.21.15.43:0/1184810736 wait complete. 2024-04-25T20:50:05.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 Processor -- start 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 -- start start 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870102ac0 0x7f7870199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 0x7f7870199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112dc0 con 0x7f7870108a70 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112c40 con 0x7f7870102ac0 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7876bba700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112f40 con 0x7f7870103480 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.734+0000 7f7875157700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46918/0 (socket says 172.21.15.43:46918) 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 -- 172.21.15.43:0/3395890249 learned_addr learned my addr 172.21.15.43:0/3395890249 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7874956700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870102ac0 0x7f7870199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:05.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f786ffff700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 0x7f7870199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 -- 172.21.15.43:0/3395890249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 msgr2=0x7f7870199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 0x7f7870199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 -- 172.21.15.43:0/3395890249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870102ac0 msgr2=0x7f7870199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870102ac0 0x7f7870199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 -- 172.21.15.43:0/3395890249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787019e0d0 con 0x7f7870108a70 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7875157700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7868007d70 tx=0x7f786800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868016020 con 0x7f7870108a70 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f786800ac90 con 0x7f7870108a70 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787019e3c0 con 0x7f7870108a70 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.735+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78680115e0 con 0x7f7870108a70 2024-04-25T20:50:05.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.736+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a5c40 con 0x7f7870108a70 2024-04-25T20:50:05.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.737+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7870069730 con 0x7f7870108a70 2024-04-25T20:50:05.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.738+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f7868019020 con 0x7f7870108a70 2024-04-25T20:50:05.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.738+0000 7f786dffb700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 0x7f78600a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:05.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.738+0000 7f7874956700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 0x7f78600a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:05.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.738+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f78680d0940 con 0x7f7870108a70 2024-04-25T20:50:05.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.739+0000 7f7874956700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 0x7f78600a6390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f786400abd0 tx=0x7f786400a380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:05.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.743+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7868020020 con 0x7f7870108a70 2024-04-25T20:50:05.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.949+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f787019a420 con 0x7f78600a3ed0 2024-04-25T20:50:05.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.956+0000 7f786dffb700 1 -- 172.21.15.43:0/3395890249 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258073 (secure 0 0 0) 0x7f787019a420 con 0x7f78600a3ed0 2024-04-25T20:50:05.960 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 msgr2=0x7f78600a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 0x7f78600a6390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f786400abd0 tx=0x7f786400a380 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 msgr2=0x7f787019d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7868007d70 tx=0x7f786800a340 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 shutdown_connections 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f78600a3ed0 0x7f78600a6390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7870108a70 0x7f787019d990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870102ac0 0x7f7870199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 --2- 172.21.15.43:0/3395890249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7870103480 0x7f7870199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 >> 172.21.15.43:0/3395890249 conn(0x7f7870079bb0 msgr2=0x7f78701016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 shutdown_connections 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:05.959+0000 7f7876bba700 1 -- 172.21.15.43:0/3395890249 wait complete. 2024-04-25T20:50:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:50:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:05 smithi043 ceph-mon[29167]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:05 smithi195 ceph-mon[33250]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:06.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:05 smithi112 ceph-mon[32322]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T20:50:06.700 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-25T20:50:04.441995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1198058,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2213,"num_read_kb":1281,"num_write":569,"num_write_kb":4420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390816,"kb_used_data":12516,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551008,"statfs":{"total":1151940427776,"available":1151540232192,"internally_reserved":0,"allocated":12816384,"data_stored":9466657,"data_compressed":218575,"data_compressed_allocated":286720,"data_compressed_original":3424256,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.991468"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517492+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:49:58.517492+0000","last_peered":"2024-04-25T20:49:58.517492+0000","last_clean":"2024-04-25T20:49:58.517492+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:49:58.517492+0000","last_undegraded":"2024-04-25T20:49:58.517492+0000","last_fullsized":"2024-04-25T20:49:58.517492+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516865+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:49:58.516865+0000","last_peered":"2024-04-25T20:49:58.516865+0000","last_clean":"2024-04-25T20:49:58.516865+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:49:58.516865+0000","last_undegraded":"2024-04-25T20:49:58.516865+0000","last_fullsized":"2024-04-25T20:49:58.516865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516579+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:49:58.516579+0000","last_peered":"2024-04-25T20:49:58.516579+0000","last_clean":"2024-04-25T20:49:58.516579+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:49:58.516579+0000","last_undegraded":"2024-04-25T20:49:58.516579+0000","last_fullsized":"2024-04-25T20:49:58.516579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429384+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:49:58.429384+0000","last_peered":"2024-04-25T20:49:58.429384+0000","last_clean":"2024-04-25T20:49:58.429384+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:49:58.429384+0000","last_undegraded":"2024-04-25T20:49:58.429384+0000","last_fullsized":"2024-04-25T20:49:58.429384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426105+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:49:58.426105+0000","last_peered":"2024-04-25T20:49:58.426105+0000","last_clean":"2024-04-25T20:49:58.426105+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:49:58.426105+0000","last_undegraded":"2024-04-25T20:49:58.426105+0000","last_fullsized":"2024-04-25T20:49:58.426105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489176+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:49:58.489176+0000","last_peered":"2024-04-25T20:49:58.489176+0000","last_clean":"2024-04-25T20:49:58.489176+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:49:58.489176+0000","last_undegraded":"2024-04-25T20:49:58.489176+0000","last_fullsized":"2024-04-25T20:49:58.489176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526625+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:49:58.526625+0000","last_peered":"2024-04-25T20:49:58.526625+0000","last_clean":"2024-04-25T20:49:58.526625+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:49:58.526625+0000","last_undegraded":"2024-04-25T20:49:58.526625+0000","last_fullsized":"2024-04-25T20:49:58.526625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537928+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:49:58.537928+0000","last_peered":"2024-04-25T20:49:58.537928+0000","last_clean":"2024-04-25T20:49:58.537928+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:49:58.537928+0000","last_undegraded":"2024-04-25T20:49:58.537928+0000","last_fullsized":"2024-04-25T20:49:58.537928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.536142+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:49:58.536142+0000","last_peered":"2024-04-25T20:49:58.536142+0000","last_clean":"2024-04-25T20:49:58.536142+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:49:58.536142+0000","last_undegraded":"2024-04-25T20:49:58.536142+0000","last_fullsized":"2024-04-25T20:49:58.536142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489490+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:49:58.489490+0000","last_peered":"2024-04-25T20:49:58.489490+0000","last_clean":"2024-04-25T20:49:58.489490+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:49:58.489490+0000","last_undegraded":"2024-04-25T20:49:58.489490+0000","last_fullsized":"2024-04-25T20:49:58.489490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429359+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:49:58.429359+0000","last_peered":"2024-04-25T20:49:58.429359+0000","last_clean":"2024-04-25T20:49:58.429359+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:49:58.429359+0000","last_undegraded":"2024-04-25T20:49:58.429359+0000","last_fullsized":"2024-04-25T20:49:58.429359+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680883+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:49:58.680883+0000","last_peered":"2024-04-25T20:49:58.680883+0000","last_clean":"2024-04-25T20:49:58.680883+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:49:58.680883+0000","last_undegraded":"2024-04-25T20:49:58.680883+0000","last_fullsized":"2024-04-25T20:49:58.680883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516328+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:49:58.516328+0000","last_peered":"2024-04-25T20:49:58.516328+0000","last_clean":"2024-04-25T20:49:58.516328+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:49:58.516328+0000","last_undegraded":"2024-04-25T20:49:58.516328+0000","last_fullsized":"2024-04-25T20:49:58.516328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516217+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:49:58.516217+0000","last_peered":"2024-04-25T20:49:58.516217+0000","last_clean":"2024-04-25T20:49:58.516217+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:49:58.516217+0000","last_undegraded":"2024-04-25T20:49:58.516217+0000","last_fullsized":"2024-04-25T20:49:58.516217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537480+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:49:58.537480+0000","last_peered":"2024-04-25T20:49:58.537480+0000","last_clean":"2024-04-25T20:49:58.537480+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:49:58.537480+0000","last_undegraded":"2024-04-25T20:49:58.537480+0000","last_fullsized":"2024-04-25T20:49:58.537480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517588+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:49:58.517588+0000","last_peered":"2024-04-25T20:49:58.517588+0000","last_clean":"2024-04-25T20:49:58.517588+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:49:58.517588+0000","last_undegraded":"2024-04-25T20:49:58.517588+0000","last_fullsized":"2024-04-25T20:49:58.517588+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424584+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:49:58.424584+0000","last_peered":"2024-04-25T20:49:58.424584+0000","last_clean":"2024-04-25T20:49:58.424584+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:49:58.424584+0000","last_undegraded":"2024-04-25T20:49:58.424584+0000","last_fullsized":"2024-04-25T20:49:58.424584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680624+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:49:58.680624+0000","last_peered":"2024-04-25T20:49:58.680624+0000","last_clean":"2024-04-25T20:49:58.680624+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:49:58.680624+0000","last_undegraded":"2024-04-25T20:49:58.680624+0000","last_fullsized":"2024-04-25T20:49:58.680624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"92'15","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681032+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:49:58.681032+0000","last_peered":"2024-04-25T20:49:58.681032+0000","last_clean":"2024-04-25T20:49:58.681032+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:49:58.681032+0000","last_undegraded":"2024-04-25T20:49:58.681032+0000","last_fullsized":"2024-04-25T20:49:58.681032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527400+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:49:58.527400+0000","last_peered":"2024-04-25T20:49:58.527400+0000","last_clean":"2024-04-25T20:49:58.527400+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:49:58.527400+0000","last_undegraded":"2024-04-25T20:49:58.527400+0000","last_fullsized":"2024-04-25T20:49:58.527400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527611+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:49:58.527611+0000","last_peered":"2024-04-25T20:49:58.527611+0000","last_clean":"2024-04-25T20:49:58.527611+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:49:58.527611+0000","last_undegraded":"2024-04-25T20:49:58.527611+0000","last_fullsized":"2024-04-25T20:49:58.527611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517148+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:49:58.517148+0000","last_peered":"2024-04-25T20:49:58.517148+0000","last_clean":"2024-04-25T20:49:58.517148+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:49:58.517148+0000","last_undegraded":"2024-04-25T20:49:58.517148+0000","last_fullsized":"2024-04-25T20:49:58.517148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426504+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:49:58.426504+0000","last_peered":"2024-04-25T20:49:58.426504+0000","last_clean":"2024-04-25T20:49:58.426504+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:49:58.426504+0000","last_undegraded":"2024-04-25T20:49:58.426504+0000","last_fullsized":"2024-04-25T20:49:58.426504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537574+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:49:58.537574+0000","last_peered":"2024-04-25T20:49:58.537574+0000","last_clean":"2024-04-25T20:49:58.537574+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:49:58.537574+0000","last_undegraded":"2024-04-25T20:49:58.537574+0000","last_fullsized":"2024-04-25T20:49:58.537574+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426346+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:49:58.426346+0000","last_peered":"2024-04-25T20:49:58.426346+0000","last_clean":"2024-04-25T20:49:58.426346+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:49:58.426346+0000","last_undegraded":"2024-04-25T20:49:58.426346+0000","last_fullsized":"2024-04-25T20:49:58.426346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533330+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:49:58.533330+0000","last_peered":"2024-04-25T20:49:58.533330+0000","last_clean":"2024-04-25T20:49:58.533330+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:49:58.533330+0000","last_undegraded":"2024-04-25T20:49:58.533330+0000","last_fullsized":"2024-04-25T20:49:58.533330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":238,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.782929+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:49:58.782929+0000","last_peered":"2024-04-25T20:49:58.782929+0000","last_clean":"2024-04-25T20:49:58.782929+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:49:58.782929+0000","last_undegraded":"2024-04-25T20:49:58.782929+0000","last_fullsized":"2024-04-25T20:49:58.782929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426009+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:49:58.426009+0000","last_peered":"2024-04-25T20:49:58.426009+0000","last_clean":"2024-04-25T20:49:58.426009+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:49:58.426009+0000","last_undegraded":"2024-04-25T20:49:58.426009+0000","last_fullsized":"2024-04-25T20:49:58.426009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535739+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:49:58.535739+0000","last_peered":"2024-04-25T20:49:58.535739+0000","last_clean":"2024-04-25T20:49:58.535739+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:49:58.535739+0000","last_undegraded":"2024-04-25T20:49:58.535739+0000","last_fullsized":"2024-04-25T20:49:58.535739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533143+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:49:58.533143+0000","last_peered":"2024-04-25T20:49:58.533143+0000","last_clean":"2024-04-25T20:49:58.533143+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:49:58.533143+0000","last_undegraded":"2024-04-25T20:49:58.533143+0000","last_fullsized":"2024-04-25T20:49:58.533143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681133+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:49:58.681133+0000","last_peered":"2024-04-25T20:49:58.681133+0000","last_clean":"2024-04-25T20:49:58.681133+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:49:58.681133+0000","last_undegraded":"2024-04-25T20:49:58.681133+0000","last_fullsized":"2024-04-25T20:49:58.681133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526715+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:49:58.526715+0000","last_peered":"2024-04-25T20:49:58.526715+0000","last_clean":"2024-04-25T20:49:58.526715+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:49:58.526715+0000","last_undegraded":"2024-04-25T20:49:58.526715+0000","last_fullsized":"2024-04-25T20:49:58.526715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.532968+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:49:58.532968+0000","last_peered":"2024-04-25T20:49:58.532968+0000","last_clean":"2024-04-25T20:49:58.532968+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:49:58.532968+0000","last_undegraded":"2024-04-25T20:49:58.532968+0000","last_fullsized":"2024-04-25T20:49:58.532968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424378+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:49:58.424378+0000","last_peered":"2024-04-25T20:49:58.424378+0000","last_clean":"2024-04-25T20:49:58.424378+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:49:58.424378+0000","last_undegraded":"2024-04-25T20:49:58.424378+0000","last_fullsized":"2024-04-25T20:49:58.424378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'8","reported_seq":423,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.782408+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:49:58.782408+0000","last_peered":"2024-04-25T20:49:58.782408+0000","last_clean":"2024-04-25T20:49:58.782408+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:49:58.782408+0000","last_undegraded":"2024-04-25T20:49:58.782408+0000","last_fullsized":"2024-04-25T20:49:58.782408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":386,"num_read_kb":386,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537888+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:49:58.537888+0000","last_peered":"2024-04-25T20:49:58.537888+0000","last_clean":"2024-04-25T20:49:58.537888+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:49:58.537888+0000","last_undegraded":"2024-04-25T20:49:58.537888+0000","last_fullsized":"2024-04-25T20:49:58.537888+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489558+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:49:58.489558+0000","last_peered":"2024-04-25T20:49:58.489558+0000","last_clean":"2024-04-25T20:49:58.489558+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:49:58.489558+0000","last_undegraded":"2024-04-25T20:49:58.489558+0000","last_fullsized":"2024-04-25T20:49:58.489558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517145+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:49:58.517145+0000","last_peered":"2024-04-25T20:49:58.517145+0000","last_clean":"2024-04-25T20:49:58.517145+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:49:58.517145+0000","last_undegraded":"2024-04-25T20:49:58.517145+0000","last_fullsized":"2024-04-25T20:49:58.517145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533409+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:49:58.533409+0000","last_peered":"2024-04-25T20:49:58.533409+0000","last_clean":"2024-04-25T20:49:58.533409+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:49:58.533409+0000","last_undegraded":"2024-04-25T20:49:58.533409+0000","last_fullsized":"2024-04-25T20:49:58.533409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537703+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:49:58.537703+0000","last_peered":"2024-04-25T20:49:58.537703+0000","last_clean":"2024-04-25T20:49:58.537703+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:49:58.537703+0000","last_undegraded":"2024-04-25T20:49:58.537703+0000","last_fullsized":"2024-04-25T20:49:58.537703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'41","reported_seq":470,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.779109+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:49:58.779109+0000","last_peered":"2024-04-25T20:49:58.779109+0000","last_clean":"2024-04-25T20:49:58.779109+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:49:58.779109+0000","last_undegraded":"2024-04-25T20:49:58.779109+0000","last_fullsized":"2024-04-25T20:49:58.779109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71436,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":400,"num_read_kb":270,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426314+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:49:58.426314+0000","last_peered":"2024-04-25T20:49:58.426314+0000","last_clean":"2024-04-25T20:49:58.426314+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:49:58.426314+0000","last_undegraded":"2024-04-25T20:49:58.426314+0000","last_fullsized":"2024-04-25T20:49:58.426314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680493+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:49:58.680493+0000","last_peered":"2024-04-25T20:49:58.680493+0000","last_clean":"2024-04-25T20:49:58.680493+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:49:58.680493+0000","last_undegraded":"2024-04-25T20:49:58.680493+0000","last_fullsized":"2024-04-25T20:49:58.680493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680951+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:49:58.680951+0000","last_peered":"2024-04-25T20:49:58.680951+0000","last_clean":"2024-04-25T20:49:58.680951+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:49:58.680951+0000","last_undegraded":"2024-04-25T20:49:58.680951+0000","last_fullsized":"2024-04-25T20:49:58.680951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533011+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:49:58.533011+0000","last_peered":"2024-04-25T20:49:58.533011+0000","last_clean":"2024-04-25T20:49:58.533011+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:49:58.533011+0000","last_undegraded":"2024-04-25T20:49:58.533011+0000","last_fullsized":"2024-04-25T20:49:58.533011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489352+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:49:58.489352+0000","last_peered":"2024-04-25T20:49:58.489352+0000","last_clean":"2024-04-25T20:49:58.489352+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:49:58.489352+0000","last_undegraded":"2024-04-25T20:49:58.489352+0000","last_fullsized":"2024-04-25T20:49:58.489352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'8","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.864719+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:49:58.864719+0000","last_peered":"2024-04-25T20:49:58.864719+0000","last_clean":"2024-04-25T20:49:58.864719+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:49:58.864719+0000","last_undegraded":"2024-04-25T20:49:58.864719+0000","last_fullsized":"2024-04-25T20:49:58.864719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489112+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:49:58.489112+0000","last_peered":"2024-04-25T20:49:58.489112+0000","last_clean":"2024-04-25T20:49:58.489112+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:49:58.489112+0000","last_undegraded":"2024-04-25T20:49:58.489112+0000","last_fullsized":"2024-04-25T20:49:58.489112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533010+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:49:58.533010+0000","last_peered":"2024-04-25T20:49:58.533010+0000","last_clean":"2024-04-25T20:49:58.533010+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:49:58.533010+0000","last_undegraded":"2024-04-25T20:49:58.533010+0000","last_fullsized":"2024-04-25T20:49:58.533010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426464+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:49:58.426464+0000","last_peered":"2024-04-25T20:49:58.426464+0000","last_clean":"2024-04-25T20:49:58.426464+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:49:58.426464+0000","last_undegraded":"2024-04-25T20:49:58.426464+0000","last_fullsized":"2024-04-25T20:49:58.426464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517414+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:49:58.517414+0000","last_peered":"2024-04-25T20:49:58.517414+0000","last_clean":"2024-04-25T20:49:58.517414+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:49:58.517414+0000","last_undegraded":"2024-04-25T20:49:58.517414+0000","last_fullsized":"2024-04-25T20:49:58.517414+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424477+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:49:58.424477+0000","last_peered":"2024-04-25T20:49:58.424477+0000","last_clean":"2024-04-25T20:49:58.424477+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:49:58.424477+0000","last_undegraded":"2024-04-25T20:49:58.424477+0000","last_fullsized":"2024-04-25T20:49:58.424477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535918+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:49:58.535918+0000","last_peered":"2024-04-25T20:49:58.535918+0000","last_clean":"2024-04-25T20:49:58.535918+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:49:58.535918+0000","last_undegraded":"2024-04-25T20:49:58.535918+0000","last_fullsized":"2024-04-25T20:49:58.535918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'9","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.786112+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:49:58.786112+0000","last_peered":"2024-04-25T20:49:58.786112+0000","last_clean":"2024-04-25T20:49:58.786112+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:49:58.786112+0000","last_undegraded":"2024-04-25T20:49:58.786112+0000","last_fullsized":"2024-04-25T20:49:58.786112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":197,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424272+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:49:58.424272+0000","last_peered":"2024-04-25T20:49:58.424272+0000","last_clean":"2024-04-25T20:49:58.424272+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:49:58.424272+0000","last_undegraded":"2024-04-25T20:49:58.424272+0000","last_fullsized":"2024-04-25T20:49:58.424272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"92'7","reported_seq":230,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.685590+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:49:58.685590+0000","last_peered":"2024-04-25T20:49:58.685590+0000","last_clean":"2024-04-25T20:49:58.685590+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:49:58.685590+0000","last_undegraded":"2024-04-25T20:49:58.685590+0000","last_fullsized":"2024-04-25T20:49:58.685590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527251+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:49:58.527251+0000","last_peered":"2024-04-25T20:49:58.527251+0000","last_clean":"2024-04-25T20:49:58.527251+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:49:58.527251+0000","last_undegraded":"2024-04-25T20:49:58.527251+0000","last_fullsized":"2024-04-25T20:49:58.527251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429311+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:49:58.429311+0000","last_peered":"2024-04-25T20:49:58.429311+0000","last_clean":"2024-04-25T20:49:58.429311+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:49:58.429311+0000","last_undegraded":"2024-04-25T20:49:58.429311+0000","last_fullsized":"2024-04-25T20:49:58.429311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489212+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:49:58.489212+0000","last_peered":"2024-04-25T20:49:58.489212+0000","last_clean":"2024-04-25T20:49:58.489212+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:49:58.489212+0000","last_undegraded":"2024-04-25T20:49:58.489212+0000","last_fullsized":"2024-04-25T20:49:58.489212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680709+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:49:58.680709+0000","last_peered":"2024-04-25T20:49:58.680709+0000","last_clean":"2024-04-25T20:49:58.680709+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:49:58.680709+0000","last_undegraded":"2024-04-25T20:49:58.680709+0000","last_fullsized":"2024-04-25T20:49:58.680709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489331+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:49:58.489331+0000","last_peered":"2024-04-25T20:49:58.489331+0000","last_clean":"2024-04-25T20:49:58.489331+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:49:58.489331+0000","last_undegraded":"2024-04-25T20:49:58.489331+0000","last_fullsized":"2024-04-25T20:49:58.489331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426353+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:49:58.426353+0000","last_peered":"2024-04-25T20:49:58.426353+0000","last_clean":"2024-04-25T20:49:58.426353+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:49:58.426353+0000","last_undegraded":"2024-04-25T20:49:58.426353+0000","last_fullsized":"2024-04-25T20:49:58.426353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681434+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:49:58.681434+0000","last_peered":"2024-04-25T20:49:58.681434+0000","last_clean":"2024-04-25T20:49:58.681434+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:49:58.681434+0000","last_undegraded":"2024-04-25T20:49:58.681434+0000","last_fullsized":"2024-04-25T20:49:58.681434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'50","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.639909+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:49:58.639909+0000","last_peered":"2024-04-25T20:49:58.639909+0000","last_clean":"2024-04-25T20:49:58.639909+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:49:58.639909+0000","last_undegraded":"2024-04-25T20:49:58.639909+0000","last_fullsized":"2024-04-25T20:49:58.639909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527081+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:49:58.527081+0000","last_peered":"2024-04-25T20:49:58.527081+0000","last_clean":"2024-04-25T20:49:58.527081+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:49:58.527081+0000","last_undegraded":"2024-04-25T20:49:58.527081+0000","last_fullsized":"2024-04-25T20:49:58.527081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429515+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:49:58.429515+0000","last_peered":"2024-04-25T20:49:58.429515+0000","last_clean":"2024-04-25T20:49:58.429515+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:49:58.429515+0000","last_undegraded":"2024-04-25T20:49:58.429515+0000","last_fullsized":"2024-04-25T20:49:58.429515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516900+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:49:58.516900+0000","last_peered":"2024-04-25T20:49:58.516900+0000","last_clean":"2024-04-25T20:49:58.516900+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:49:58.516900+0000","last_undegraded":"2024-04-25T20:49:58.516900+0000","last_fullsized":"2024-04-25T20:49:58.516900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537491+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:49:58.537491+0000","last_peered":"2024-04-25T20:49:58.537491+0000","last_clean":"2024-04-25T20:49:58.537491+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:49:58.537491+0000","last_undegraded":"2024-04-25T20:49:58.537491+0000","last_fullsized":"2024-04-25T20:49:58.537491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526907+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:49:58.526907+0000","last_peered":"2024-04-25T20:49:58.526907+0000","last_clean":"2024-04-25T20:49:58.526907+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:49:58.526907+0000","last_undegraded":"2024-04-25T20:49:58.526907+0000","last_fullsized":"2024-04-25T20:49:58.526907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517181+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:49:58.517181+0000","last_peered":"2024-04-25T20:49:58.517181+0000","last_clean":"2024-04-25T20:49:58.517181+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:49:58.517181+0000","last_undegraded":"2024-04-25T20:49:58.517181+0000","last_fullsized":"2024-04-25T20:49:58.517181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680259+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:49:58.680259+0000","last_peered":"2024-04-25T20:49:58.680259+0000","last_clean":"2024-04-25T20:49:58.680259+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:49:58.680259+0000","last_undegraded":"2024-04-25T20:49:58.680259+0000","last_fullsized":"2024-04-25T20:49:58.680259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526892+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:49:58.526892+0000","last_peered":"2024-04-25T20:49:58.526892+0000","last_clean":"2024-04-25T20:49:58.526892+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:49:58.526892+0000","last_undegraded":"2024-04-25T20:49:58.526892+0000","last_fullsized":"2024-04-25T20:49:58.526892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517138+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:49:58.517138+0000","last_peered":"2024-04-25T20:49:58.517138+0000","last_clean":"2024-04-25T20:49:58.517138+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:49:58.517138+0000","last_undegraded":"2024-04-25T20:49:58.517138+0000","last_fullsized":"2024-04-25T20:49:58.517138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489363+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:49:58.489363+0000","last_peered":"2024-04-25T20:49:58.489363+0000","last_clean":"2024-04-25T20:49:58.489363+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:49:58.489363+0000","last_undegraded":"2024-04-25T20:49:58.489363+0000","last_fullsized":"2024-04-25T20:49:58.489363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'8","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.786331+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:49:58.786331+0000","last_peered":"2024-04-25T20:49:58.786331+0000","last_clean":"2024-04-25T20:49:58.786331+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:49:58.786331+0000","last_undegraded":"2024-04-25T20:49:58.786331+0000","last_fullsized":"2024-04-25T20:49:58.786331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":198,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489597+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:49:58.489597+0000","last_peered":"2024-04-25T20:49:58.489597+0000","last_clean":"2024-04-25T20:49:58.489597+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:49:58.489597+0000","last_undegraded":"2024-04-25T20:49:58.489597+0000","last_fullsized":"2024-04-25T20:49:58.489597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.637533+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:49:58.637533+0000","last_peered":"2024-04-25T20:49:58.637533+0000","last_clean":"2024-04-25T20:49:58.637533+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:49:58.637533+0000","last_undegraded":"2024-04-25T20:49:58.637533+0000","last_fullsized":"2024-04-25T20:49:58.637533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489311+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:49:58.489311+0000","last_peered":"2024-04-25T20:49:58.489311+0000","last_clean":"2024-04-25T20:49:58.489311+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:49:58.489311+0000","last_undegraded":"2024-04-25T20:49:58.489311+0000","last_fullsized":"2024-04-25T20:49:58.489311+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681526+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:49:58.681526+0000","last_peered":"2024-04-25T20:49:58.681526+0000","last_clean":"2024-04-25T20:49:58.681526+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:49:58.681526+0000","last_undegraded":"2024-04-25T20:49:58.681526+0000","last_fullsized":"2024-04-25T20:49:58.681526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489644+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:49:58.489644+0000","last_peered":"2024-04-25T20:49:58.489644+0000","last_clean":"2024-04-25T20:49:58.489644+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:49:58.489644+0000","last_undegraded":"2024-04-25T20:49:58.489644+0000","last_fullsized":"2024-04-25T20:49:58.489644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517178+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:49:58.517178+0000","last_peered":"2024-04-25T20:49:58.517178+0000","last_clean":"2024-04-25T20:49:58.517178+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:49:58.517178+0000","last_undegraded":"2024-04-25T20:49:58.517178+0000","last_fullsized":"2024-04-25T20:49:58.517178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680328+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:49:58.680328+0000","last_peered":"2024-04-25T20:49:58.680328+0000","last_clean":"2024-04-25T20:49:58.680328+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:49:58.680328+0000","last_undegraded":"2024-04-25T20:49:58.680328+0000","last_fullsized":"2024-04-25T20:49:58.680328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680241+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:49:58.680241+0000","last_peered":"2024-04-25T20:49:58.680241+0000","last_clean":"2024-04-25T20:49:58.680241+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:49:58.680241+0000","last_undegraded":"2024-04-25T20:49:58.680241+0000","last_fullsized":"2024-04-25T20:49:58.680241+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516505+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:49:58.516505+0000","last_peered":"2024-04-25T20:49:58.516505+0000","last_clean":"2024-04-25T20:49:58.516505+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:49:58.516505+0000","last_undegraded":"2024-04-25T20:49:58.516505+0000","last_fullsized":"2024-04-25T20:49:58.516505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681247+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:49:58.681247+0000","last_peered":"2024-04-25T20:49:58.681247+0000","last_clean":"2024-04-25T20:49:58.681247+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:49:58.681247+0000","last_undegraded":"2024-04-25T20:49:58.681247+0000","last_fullsized":"2024-04-25T20:49:58.681247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517378+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:49:58.517378+0000","last_peered":"2024-04-25T20:49:58.517378+0000","last_clean":"2024-04-25T20:49:58.517378+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:49:58.517378+0000","last_undegraded":"2024-04-25T20:49:58.517378+0000","last_fullsized":"2024-04-25T20:49:58.517378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680645+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:49:58.680645+0000","last_peered":"2024-04-25T20:49:58.680645+0000","last_clean":"2024-04-25T20:49:58.680645+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:49:58.680645+0000","last_undegraded":"2024-04-25T20:49:58.680645+0000","last_fullsized":"2024-04-25T20:49:58.680645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526828+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:49:58.526828+0000","last_peered":"2024-04-25T20:49:58.526828+0000","last_clean":"2024-04-25T20:49:58.526828+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:49:58.526828+0000","last_undegraded":"2024-04-25T20:49:58.526828+0000","last_fullsized":"2024-04-25T20:49:58.526828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680693+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:49:58.680693+0000","last_peered":"2024-04-25T20:49:58.680693+0000","last_clean":"2024-04-25T20:49:58.680693+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:49:58.680693+0000","last_undegraded":"2024-04-25T20:49:58.680693+0000","last_fullsized":"2024-04-25T20:49:58.680693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526808+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:49:58.526808+0000","last_peered":"2024-04-25T20:49:58.526808+0000","last_clean":"2024-04-25T20:49:58.526808+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:49:58.526808+0000","last_undegraded":"2024-04-25T20:49:58.526808+0000","last_fullsized":"2024-04-25T20:49:58.526808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537617+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:49:58.537617+0000","last_peered":"2024-04-25T20:49:58.537617+0000","last_clean":"2024-04-25T20:49:58.537617+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:49:58.537617+0000","last_undegraded":"2024-04-25T20:49:58.537617+0000","last_fullsized":"2024-04-25T20:49:58.537617+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681231+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:49:58.681231+0000","last_peered":"2024-04-25T20:49:58.681231+0000","last_clean":"2024-04-25T20:49:58.681231+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:49:58.681231+0000","last_undegraded":"2024-04-25T20:49:58.681231+0000","last_fullsized":"2024-04-25T20:49:58.681231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517186+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:49:58.517186+0000","last_peered":"2024-04-25T20:49:58.517186+0000","last_clean":"2024-04-25T20:49:58.517186+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:49:58.517186+0000","last_undegraded":"2024-04-25T20:49:58.517186+0000","last_fullsized":"2024-04-25T20:49:58.517186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":607456,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2077,"num_read_kb":1162,"num_write":386,"num_write_kb":1480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1822759,"data_compressed":81372,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351034,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1007616,"data_stored":493009,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32340,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712812,"statfs":{"total":95995035648,"available":95961919488,"internally_reserved":0,"allocated":1191936,"data_stored":1287465,"data_compressed":46991,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":885623,"data_compressed":22041,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037833,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1052672,"data_stored":886001,"data_compressed":22041,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1081344,"data_stored":1088771,"data_compressed":39013,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462995,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":483729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":564223,"data_compressed":4717,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1036288,"data_stored":494777,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411433,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":556356,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149794,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":1016765,"data_compressed":28197,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888158,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":492908,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724633,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":1217030,"data_compressed":45068,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":74502,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":75953,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":136042,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":205695,"data_compressed":7978,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:50:06.704 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T20:50:06.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T20:50:06.966 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:07.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:06 smithi043 ceph-mon[29167]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:07.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:06 smithi195 ceph-mon[33250]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:07.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:06 smithi112 ceph-mon[32322]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:08.123 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:07 smithi043 ceph-mon[29167]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 169 KiB/s wr, 105 op/s 2024-04-25T20:50:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:07 smithi195 ceph-mon[33250]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 169 KiB/s wr, 105 op/s 2024-04-25T20:50:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:07 smithi112 ceph-mon[32322]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 169 KiB/s wr, 105 op/s 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- 172.21.15.43:0/2123983714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 msgr2=0x7f4b54111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 --2- 172.21.15.43:0/2123983714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b54111860 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b0a0 tx=0x7f4b4c00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- 172.21.15.43:0/2123983714 shutdown_connections 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 --2- 172.21.15.43:0/2123983714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 0x7f4b54075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 --2- 172.21.15.43:0/2123983714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b54111860 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 --2- 172.21.15.43:0/2123983714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 0x7f4b5410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- 172.21.15.43:0/2123983714 >> 172.21.15.43:0/2123983714 conn(0x7f4b54079bb0 msgr2=0x7f4b54079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- 172.21.15.43:0/2123983714 shutdown_connections 2024-04-25T20:50:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- 172.21.15.43:0/2123983714 wait complete. 2024-04-25T20:50:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 Processor -- start 2024-04-25T20:50:08.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.685+0000 7f4b5b925700 1 -- start start 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 0x7f4b5419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 0x7f4b5419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54114f50 con 0x7f4b5410f470 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b54114dd0 con 0x7f4b54075590 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b5b925700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4b541150d0 con 0x7f4b54074c70 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46946/0 (socket says 172.21.15.43:46946) 2024-04-25T20:50:08.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 -- 172.21.15.43:0/616665706 learned_addr learned my addr 172.21.15.43:0/616665706 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b596c1700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 0x7f4b5419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b58ec0700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 0x7f4b5419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 -- 172.21.15.43:0/616665706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 msgr2=0x7f4b5419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 0x7f4b5419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 -- 172.21.15.43:0/616665706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 msgr2=0x7f4b5419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 0x7f4b5419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.686+0000 7f4b59ec2700 1 -- 172.21.15.43:0/616665706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b541a02d0 con 0x7f4b5410f470 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b59ec2700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b830 tx=0x7f4b4c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c021020 con 0x7f4b5410f470 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b4c01db40 con 0x7f4b5410f470 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c01bb50 con 0x7f4b5410f470 2024-04-25T20:50:08.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b541a0560 con 0x7f4b5410f470 2024-04-25T20:50:08.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.687+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b541a7e40 con 0x7f4b5410f470 2024-04-25T20:50:08.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.688+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b54069730 con 0x7f4b5410f470 2024-04-25T20:50:08.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.689+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f4b4c024020 con 0x7f4b5410f470 2024-04-25T20:50:08.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.690+0000 7f4b4a7fc700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 0x7f4b400a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:08.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.690+0000 7f4b596c1700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 0x7f4b400a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:08.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.690+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4b4c00f020 con 0x7f4b5410f470 2024-04-25T20:50:08.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.690+0000 7f4b596c1700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 0x7f4b400a6390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000ac50 tx=0x7f4b5000a380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:08.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.694+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4b4c09e1d0 con 0x7f4b5410f470 2024-04-25T20:50:08.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.896+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b54100210 con 0x7f4b400a3ed0 2024-04-25T20:50:08.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.903+0000 7f4b4a7fc700 1 -- 172.21.15.43:0/616665706 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258116 (secure 0 0 0) 0x7f4b54100210 con 0x7f4b400a3ed0 2024-04-25T20:50:08.907 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:08.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 msgr2=0x7f4b400a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:08.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 0x7f4b400a6390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000ac50 tx=0x7f4b5000a380 comp rx=0 tx=0).stop 2024-04-25T20:50:08.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 msgr2=0x7f4b5419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b830 tx=0x7f4b4c007a90 comp rx=0 tx=0).stop 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 shutdown_connections 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4b400a3ed0 0x7f4b400a6390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b54074c70 0x7f4b5419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b5410f470 0x7f4b5419fb90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 --2- 172.21.15.43:0/616665706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b54075590 0x7f4b5419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 >> 172.21.15.43:0/616665706 conn(0x7f4b54079bb0 msgr2=0x7f4b540ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 shutdown_connections 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:08.906+0000 7f4b5b925700 1 -- 172.21.15.43:0/616665706 wait complete. 2024-04-25T20:50:08.910 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-25T20:50:09.621 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-04-25T20:50:08.443128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1396994,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2742,"num_read_kb":1862,"num_write":779,"num_write_kb":5604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1083,"ondisk_log_size":1083,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390924,"kb_used_data":12612,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550900,"statfs":{"total":1151940427776,"available":1151540121600,"internally_reserved":0,"allocated":12914688,"data_stored":10086402,"data_compressed":252054,"data_compressed_allocated":331776,"data_compressed_original":3993600,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":198936,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":529,"num_read_kb":581,"num_write":210,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.992601"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517492+0000","last_change":"2024-04-25T20:46:25.486038+0000","last_active":"2024-04-25T20:49:58.517492+0000","last_peered":"2024-04-25T20:49:58.517492+0000","last_clean":"2024-04-25T20:49:58.517492+0000","last_became_active":"2024-04-25T20:46:25.485510+0000","last_became_peered":"2024-04-25T20:46:25.485510+0000","last_unstale":"2024-04-25T20:49:58.517492+0000","last_undegraded":"2024-04-25T20:49:58.517492+0000","last_fullsized":"2024-04-25T20:49:58.517492+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:25.209063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516865+0000","last_change":"2024-04-25T20:46:25.485409+0000","last_active":"2024-04-25T20:49:58.516865+0000","last_peered":"2024-04-25T20:49:58.516865+0000","last_clean":"2024-04-25T20:49:58.516865+0000","last_became_active":"2024-04-25T20:46:25.485110+0000","last_became_peered":"2024-04-25T20:46:25.485110+0000","last_unstale":"2024-04-25T20:49:58.516865+0000","last_undegraded":"2024-04-25T20:49:58.516865+0000","last_fullsized":"2024-04-25T20:49:58.516865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:20.182861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516579+0000","last_change":"2024-04-25T20:46:25.484773+0000","last_active":"2024-04-25T20:49:58.516579+0000","last_peered":"2024-04-25T20:49:58.516579+0000","last_clean":"2024-04-25T20:49:58.516579+0000","last_became_active":"2024-04-25T20:46:25.484224+0000","last_became_peered":"2024-04-25T20:46:25.484224+0000","last_unstale":"2024-04-25T20:49:58.516579+0000","last_undegraded":"2024-04-25T20:49:58.516579+0000","last_fullsized":"2024-04-25T20:49:58.516579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:31.134291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429384+0000","last_change":"2024-04-25T20:46:25.477937+0000","last_active":"2024-04-25T20:49:58.429384+0000","last_peered":"2024-04-25T20:49:58.429384+0000","last_clean":"2024-04-25T20:49:58.429384+0000","last_became_active":"2024-04-25T20:46:25.477574+0000","last_became_peered":"2024-04-25T20:46:25.477574+0000","last_unstale":"2024-04-25T20:49:58.429384+0000","last_undegraded":"2024-04-25T20:49:58.429384+0000","last_fullsized":"2024-04-25T20:49:58.429384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:30:07.357277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426105+0000","last_change":"2024-04-25T20:46:25.481135+0000","last_active":"2024-04-25T20:49:58.426105+0000","last_peered":"2024-04-25T20:49:58.426105+0000","last_clean":"2024-04-25T20:49:58.426105+0000","last_became_active":"2024-04-25T20:46:25.479507+0000","last_became_peered":"2024-04-25T20:46:25.479507+0000","last_unstale":"2024-04-25T20:49:58.426105+0000","last_undegraded":"2024-04-25T20:49:58.426105+0000","last_fullsized":"2024-04-25T20:49:58.426105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:13.172139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.757617+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.757214+0000","last_became_peered":"2024-04-25T20:47:05.757214+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:57:25.657600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489176+0000","last_change":"2024-04-25T20:46:25.476889+0000","last_active":"2024-04-25T20:49:58.489176+0000","last_peered":"2024-04-25T20:49:58.489176+0000","last_clean":"2024-04-25T20:49:58.489176+0000","last_became_active":"2024-04-25T20:46:25.474915+0000","last_became_peered":"2024-04-25T20:46:25.474915+0000","last_unstale":"2024-04-25T20:49:58.489176+0000","last_undegraded":"2024-04-25T20:49:58.489176+0000","last_fullsized":"2024-04-25T20:49:58.489176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:35.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526625+0000","last_change":"2024-04-25T20:46:25.491993+0000","last_active":"2024-04-25T20:49:58.526625+0000","last_peered":"2024-04-25T20:49:58.526625+0000","last_clean":"2024-04-25T20:49:58.526625+0000","last_became_active":"2024-04-25T20:46:25.491606+0000","last_became_peered":"2024-04-25T20:46:25.491606+0000","last_unstale":"2024-04-25T20:49:58.526625+0000","last_undegraded":"2024-04-25T20:49:58.526625+0000","last_fullsized":"2024-04-25T20:49:58.526625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:52.102678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537928+0000","last_change":"2024-04-25T20:46:25.476548+0000","last_active":"2024-04-25T20:49:58.537928+0000","last_peered":"2024-04-25T20:49:58.537928+0000","last_clean":"2024-04-25T20:49:58.537928+0000","last_became_active":"2024-04-25T20:46:25.476238+0000","last_became_peered":"2024-04-25T20:46:25.476238+0000","last_unstale":"2024-04-25T20:49:58.537928+0000","last_undegraded":"2024-04-25T20:49:58.537928+0000","last_fullsized":"2024-04-25T20:49:58.537928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:40.428159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.536142+0000","last_change":"2024-04-25T20:46:25.491679+0000","last_active":"2024-04-25T20:49:58.536142+0000","last_peered":"2024-04-25T20:49:58.536142+0000","last_clean":"2024-04-25T20:49:58.536142+0000","last_became_active":"2024-04-25T20:46:25.491286+0000","last_became_peered":"2024-04-25T20:46:25.491286+0000","last_unstale":"2024-04-25T20:49:58.536142+0000","last_undegraded":"2024-04-25T20:49:58.536142+0000","last_fullsized":"2024-04-25T20:49:58.536142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:10:12.611704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489490+0000","last_change":"2024-04-25T20:46:25.482947+0000","last_active":"2024-04-25T20:49:58.489490+0000","last_peered":"2024-04-25T20:49:58.489490+0000","last_clean":"2024-04-25T20:49:58.489490+0000","last_became_active":"2024-04-25T20:46:25.482617+0000","last_became_peered":"2024-04-25T20:46:25.482617+0000","last_unstale":"2024-04-25T20:49:58.489490+0000","last_undegraded":"2024-04-25T20:49:58.489490+0000","last_fullsized":"2024-04-25T20:49:58.489490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:50:47.476353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429359+0000","last_change":"2024-04-25T20:46:25.486406+0000","last_active":"2024-04-25T20:49:58.429359+0000","last_peered":"2024-04-25T20:49:58.429359+0000","last_clean":"2024-04-25T20:49:58.429359+0000","last_became_active":"2024-04-25T20:46:25.484326+0000","last_became_peered":"2024-04-25T20:46:25.484326+0000","last_unstale":"2024-04-25T20:49:58.429359+0000","last_undegraded":"2024-04-25T20:49:58.429359+0000","last_fullsized":"2024-04-25T20:49:58.429359+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:10.803876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680883+0000","last_change":"2024-04-25T20:46:25.490485+0000","last_active":"2024-04-25T20:49:58.680883+0000","last_peered":"2024-04-25T20:49:58.680883+0000","last_clean":"2024-04-25T20:49:58.680883+0000","last_became_active":"2024-04-25T20:46:25.490169+0000","last_became_peered":"2024-04-25T20:46:25.490169+0000","last_unstale":"2024-04-25T20:49:58.680883+0000","last_undegraded":"2024-04-25T20:49:58.680883+0000","last_fullsized":"2024-04-25T20:49:58.680883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:02:09.714351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516328+0000","last_change":"2024-04-25T20:46:25.478435+0000","last_active":"2024-04-25T20:49:58.516328+0000","last_peered":"2024-04-25T20:49:58.516328+0000","last_clean":"2024-04-25T20:49:58.516328+0000","last_became_active":"2024-04-25T20:46:25.478099+0000","last_became_peered":"2024-04-25T20:46:25.478099+0000","last_unstale":"2024-04-25T20:49:58.516328+0000","last_undegraded":"2024-04-25T20:49:58.516328+0000","last_fullsized":"2024-04-25T20:49:58.516328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:05.107838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516217+0000","last_change":"2024-04-25T20:46:25.484187+0000","last_active":"2024-04-25T20:49:58.516217+0000","last_peered":"2024-04-25T20:49:58.516217+0000","last_clean":"2024-04-25T20:49:58.516217+0000","last_became_active":"2024-04-25T20:46:25.483863+0000","last_became_peered":"2024-04-25T20:46:25.483863+0000","last_unstale":"2024-04-25T20:49:58.516217+0000","last_undegraded":"2024-04-25T20:49:58.516217+0000","last_fullsized":"2024-04-25T20:49:58.516217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:26.366414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537480+0000","last_change":"2024-04-25T20:46:25.477328+0000","last_active":"2024-04-25T20:49:58.537480+0000","last_peered":"2024-04-25T20:49:58.537480+0000","last_clean":"2024-04-25T20:49:58.537480+0000","last_became_active":"2024-04-25T20:46:25.476991+0000","last_became_peered":"2024-04-25T20:46:25.476991+0000","last_unstale":"2024-04-25T20:49:58.537480+0000","last_undegraded":"2024-04-25T20:49:58.537480+0000","last_fullsized":"2024-04-25T20:49:58.537480+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:09.407517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517588+0000","last_change":"2024-04-25T20:46:25.489270+0000","last_active":"2024-04-25T20:49:58.517588+0000","last_peered":"2024-04-25T20:49:58.517588+0000","last_clean":"2024-04-25T20:49:58.517588+0000","last_became_active":"2024-04-25T20:46:25.488509+0000","last_became_peered":"2024-04-25T20:46:25.488509+0000","last_unstale":"2024-04-25T20:49:58.517588+0000","last_undegraded":"2024-04-25T20:49:58.517588+0000","last_fullsized":"2024-04-25T20:49:58.517588+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.073545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424584+0000","last_change":"2024-04-25T20:46:25.484602+0000","last_active":"2024-04-25T20:49:58.424584+0000","last_peered":"2024-04-25T20:49:58.424584+0000","last_clean":"2024-04-25T20:49:58.424584+0000","last_became_active":"2024-04-25T20:46:25.484295+0000","last_became_peered":"2024-04-25T20:46:25.484295+0000","last_unstale":"2024-04-25T20:49:58.424584+0000","last_undegraded":"2024-04-25T20:49:58.424584+0000","last_fullsized":"2024-04-25T20:49:58.424584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:06.697728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680624+0000","last_change":"2024-04-25T20:46:25.481501+0000","last_active":"2024-04-25T20:49:58.680624+0000","last_peered":"2024-04-25T20:49:58.680624+0000","last_clean":"2024-04-25T20:49:58.680624+0000","last_became_active":"2024-04-25T20:46:25.481153+0000","last_became_peered":"2024-04-25T20:46:25.481153+0000","last_unstale":"2024-04-25T20:49:58.680624+0000","last_undegraded":"2024-04-25T20:49:58.680624+0000","last_fullsized":"2024-04-25T20:49:58.680624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:39.233863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"92'15","reported_seq":243,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.791175+0000","last_change":"2024-04-25T20:46:21.427267+0000","last_active":"2024-04-25T20:50:02.791175+0000","last_peered":"2024-04-25T20:50:02.791175+0000","last_clean":"2024-04-25T20:50:02.791175+0000","last_became_active":"2024-04-25T20:46:21.426895+0000","last_became_peered":"2024-04-25T20:46:21.426895+0000","last_unstale":"2024-04-25T20:50:02.791175+0000","last_undegraded":"2024-04-25T20:50:02.791175+0000","last_fullsized":"2024-04-25T20:50:02.791175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:27.835917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":199,"num_read_kb":199,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527400+0000","last_change":"2024-04-25T20:46:25.493347+0000","last_active":"2024-04-25T20:49:58.527400+0000","last_peered":"2024-04-25T20:49:58.527400+0000","last_clean":"2024-04-25T20:49:58.527400+0000","last_became_active":"2024-04-25T20:46:25.493046+0000","last_became_peered":"2024-04-25T20:46:25.493046+0000","last_unstale":"2024-04-25T20:49:58.527400+0000","last_undegraded":"2024-04-25T20:49:58.527400+0000","last_fullsized":"2024-04-25T20:49:58.527400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:04.038581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527611+0000","last_change":"2024-04-25T20:46:21.497218+0000","last_active":"2024-04-25T20:49:58.527611+0000","last_peered":"2024-04-25T20:49:58.527611+0000","last_clean":"2024-04-25T20:49:58.527611+0000","last_became_active":"2024-04-25T20:46:21.496848+0000","last_became_peered":"2024-04-25T20:46:21.496848+0000","last_unstale":"2024-04-25T20:49:58.527611+0000","last_undegraded":"2024-04-25T20:49:58.527611+0000","last_fullsized":"2024-04-25T20:49:58.527611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:10.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517148+0000","last_change":"2024-04-25T20:46:25.475713+0000","last_active":"2024-04-25T20:49:58.517148+0000","last_peered":"2024-04-25T20:49:58.517148+0000","last_clean":"2024-04-25T20:49:58.517148+0000","last_became_active":"2024-04-25T20:46:25.475425+0000","last_became_peered":"2024-04-25T20:46:25.475425+0000","last_unstale":"2024-04-25T20:49:58.517148+0000","last_undegraded":"2024-04-25T20:49:58.517148+0000","last_fullsized":"2024-04-25T20:49:58.517148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:09.473036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426504+0000","last_change":"2024-04-25T20:46:21.430580+0000","last_active":"2024-04-25T20:49:58.426504+0000","last_peered":"2024-04-25T20:49:58.426504+0000","last_clean":"2024-04-25T20:49:58.426504+0000","last_became_active":"2024-04-25T20:46:21.430102+0000","last_became_peered":"2024-04-25T20:46:21.430102+0000","last_unstale":"2024-04-25T20:49:58.426504+0000","last_undegraded":"2024-04-25T20:49:58.426504+0000","last_fullsized":"2024-04-25T20:49:58.426504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:03.897714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537574+0000","last_change":"2024-04-25T20:46:25.479021+0000","last_active":"2024-04-25T20:49:58.537574+0000","last_peered":"2024-04-25T20:49:58.537574+0000","last_clean":"2024-04-25T20:49:58.537574+0000","last_became_active":"2024-04-25T20:46:25.478689+0000","last_became_peered":"2024-04-25T20:46:25.478689+0000","last_unstale":"2024-04-25T20:49:58.537574+0000","last_undegraded":"2024-04-25T20:49:58.537574+0000","last_fullsized":"2024-04-25T20:49:58.537574+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:26:55.621872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426346+0000","last_change":"2024-04-25T20:46:21.431171+0000","last_active":"2024-04-25T20:49:58.426346+0000","last_peered":"2024-04-25T20:49:58.426346+0000","last_clean":"2024-04-25T20:49:58.426346+0000","last_became_active":"2024-04-25T20:46:21.430794+0000","last_became_peered":"2024-04-25T20:46:21.430794+0000","last_unstale":"2024-04-25T20:49:58.426346+0000","last_undegraded":"2024-04-25T20:49:58.426346+0000","last_fullsized":"2024-04-25T20:49:58.426346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:49:39.578551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533330+0000","last_change":"2024-04-25T20:46:25.486808+0000","last_active":"2024-04-25T20:49:58.533330+0000","last_peered":"2024-04-25T20:49:58.533330+0000","last_clean":"2024-04-25T20:49:58.533330+0000","last_became_active":"2024-04-25T20:46:25.485947+0000","last_became_peered":"2024-04-25T20:46:25.485947+0000","last_unstale":"2024-04-25T20:49:58.533330+0000","last_undegraded":"2024-04-25T20:49:58.533330+0000","last_fullsized":"2024-04-25T20:49:58.533330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:17:06.242016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":243,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.787305+0000","last_change":"2024-04-25T20:46:21.433549+0000","last_active":"2024-04-25T20:50:02.787305+0000","last_peered":"2024-04-25T20:50:02.787305+0000","last_clean":"2024-04-25T20:50:02.787305+0000","last_became_active":"2024-04-25T20:46:21.433051+0000","last_became_peered":"2024-04-25T20:46:21.433051+0000","last_unstale":"2024-04-25T20:50:02.787305+0000","last_undegraded":"2024-04-25T20:50:02.787305+0000","last_fullsized":"2024-04-25T20:50:02.787305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:27:03.818042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":204,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426009+0000","last_change":"2024-04-25T20:46:25.487041+0000","last_active":"2024-04-25T20:49:58.426009+0000","last_peered":"2024-04-25T20:49:58.426009+0000","last_clean":"2024-04-25T20:49:58.426009+0000","last_became_active":"2024-04-25T20:46:25.486722+0000","last_became_peered":"2024-04-25T20:46:25.486722+0000","last_unstale":"2024-04-25T20:49:58.426009+0000","last_undegraded":"2024-04-25T20:49:58.426009+0000","last_fullsized":"2024-04-25T20:49:58.426009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:59.150922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535739+0000","last_change":"2024-04-25T20:46:21.428491+0000","last_active":"2024-04-25T20:49:58.535739+0000","last_peered":"2024-04-25T20:49:58.535739+0000","last_clean":"2024-04-25T20:49:58.535739+0000","last_became_active":"2024-04-25T20:46:21.428153+0000","last_became_peered":"2024-04-25T20:46:21.428153+0000","last_unstale":"2024-04-25T20:49:58.535739+0000","last_undegraded":"2024-04-25T20:49:58.535739+0000","last_fullsized":"2024-04-25T20:49:58.535739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:06:30.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533143+0000","last_change":"2024-04-25T20:47:05.920027+0000","last_active":"2024-04-25T20:49:58.533143+0000","last_peered":"2024-04-25T20:49:58.533143+0000","last_clean":"2024-04-25T20:49:58.533143+0000","last_became_active":"2024-04-25T20:47:05.919656+0000","last_became_peered":"2024-04-25T20:47:05.919656+0000","last_unstale":"2024-04-25T20:49:58.533143+0000","last_undegraded":"2024-04-25T20:49:58.533143+0000","last_fullsized":"2024-04-25T20:49:58.533143+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:22:16.057326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,8],"acting":[5,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681133+0000","last_change":"2024-04-25T20:46:21.427192+0000","last_active":"2024-04-25T20:49:58.681133+0000","last_peered":"2024-04-25T20:49:58.681133+0000","last_clean":"2024-04-25T20:49:58.681133+0000","last_became_active":"2024-04-25T20:46:21.426842+0000","last_became_peered":"2024-04-25T20:46:21.426842+0000","last_unstale":"2024-04-25T20:49:58.681133+0000","last_undegraded":"2024-04-25T20:49:58.681133+0000","last_fullsized":"2024-04-25T20:49:58.681133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:51.017431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526715+0000","last_change":"2024-04-25T20:46:25.480747+0000","last_active":"2024-04-25T20:49:58.526715+0000","last_peered":"2024-04-25T20:49:58.526715+0000","last_clean":"2024-04-25T20:49:58.526715+0000","last_became_active":"2024-04-25T20:46:25.480414+0000","last_became_peered":"2024-04-25T20:46:25.480414+0000","last_unstale":"2024-04-25T20:49:58.526715+0000","last_undegraded":"2024-04-25T20:49:58.526715+0000","last_fullsized":"2024-04-25T20:49:58.526715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:05.601695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.532968+0000","last_change":"2024-04-25T20:46:21.426375+0000","last_active":"2024-04-25T20:49:58.532968+0000","last_peered":"2024-04-25T20:49:58.532968+0000","last_clean":"2024-04-25T20:49:58.532968+0000","last_became_active":"2024-04-25T20:46:21.425246+0000","last_became_peered":"2024-04-25T20:46:21.425246+0000","last_unstale":"2024-04-25T20:49:58.532968+0000","last_undegraded":"2024-04-25T20:49:58.532968+0000","last_fullsized":"2024-04-25T20:49:58.532968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:55.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424378+0000","last_change":"2024-04-25T20:46:25.479697+0000","last_active":"2024-04-25T20:49:58.424378+0000","last_peered":"2024-04-25T20:49:58.424378+0000","last_clean":"2024-04-25T20:49:58.424378+0000","last_became_active":"2024-04-25T20:46:25.479386+0000","last_became_peered":"2024-04-25T20:46:25.479386+0000","last_unstale":"2024-04-25T20:49:58.424378+0000","last_undegraded":"2024-04-25T20:49:58.424378+0000","last_fullsized":"2024-04-25T20:49:58.424378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:02.100507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"92'8","reported_seq":433,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:03.787853+0000","last_change":"2024-04-25T20:46:21.433883+0000","last_active":"2024-04-25T20:50:03.787853+0000","last_peered":"2024-04-25T20:50:03.787853+0000","last_clean":"2024-04-25T20:50:03.787853+0000","last_became_active":"2024-04-25T20:46:21.433507+0000","last_became_peered":"2024-04-25T20:46:21.433507+0000","last_unstale":"2024-04-25T20:50:03.787853+0000","last_undegraded":"2024-04-25T20:50:03.787853+0000","last_fullsized":"2024-04-25T20:50:03.787853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:50.098200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":396,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537888+0000","last_change":"2024-04-25T20:46:25.485488+0000","last_active":"2024-04-25T20:49:58.537888+0000","last_peered":"2024-04-25T20:49:58.537888+0000","last_clean":"2024-04-25T20:49:58.537888+0000","last_became_active":"2024-04-25T20:46:25.485139+0000","last_became_peered":"2024-04-25T20:46:25.485139+0000","last_unstale":"2024-04-25T20:49:58.537888+0000","last_undegraded":"2024-04-25T20:49:58.537888+0000","last_fullsized":"2024-04-25T20:49:58.537888+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:33.349897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489558+0000","last_change":"2024-04-25T20:46:21.430677+0000","last_active":"2024-04-25T20:49:58.489558+0000","last_peered":"2024-04-25T20:49:58.489558+0000","last_clean":"2024-04-25T20:49:58.489558+0000","last_became_active":"2024-04-25T20:46:21.430270+0000","last_became_peered":"2024-04-25T20:46:21.430270+0000","last_unstale":"2024-04-25T20:49:58.489558+0000","last_undegraded":"2024-04-25T20:49:58.489558+0000","last_fullsized":"2024-04-25T20:49:58.489558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:51.423143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517145+0000","last_change":"2024-04-25T20:46:25.475034+0000","last_active":"2024-04-25T20:49:58.517145+0000","last_peered":"2024-04-25T20:49:58.517145+0000","last_clean":"2024-04-25T20:49:58.517145+0000","last_became_active":"2024-04-25T20:46:25.474644+0000","last_became_peered":"2024-04-25T20:46:25.474644+0000","last_unstale":"2024-04-25T20:49:58.517145+0000","last_undegraded":"2024-04-25T20:49:58.517145+0000","last_fullsized":"2024-04-25T20:49:58.517145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:50.000061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533409+0000","last_change":"2024-04-25T20:46:21.499237+0000","last_active":"2024-04-25T20:49:58.533409+0000","last_peered":"2024-04-25T20:49:58.533409+0000","last_clean":"2024-04-25T20:49:58.533409+0000","last_became_active":"2024-04-25T20:46:21.498844+0000","last_became_peered":"2024-04-25T20:46:21.498844+0000","last_unstale":"2024-04-25T20:49:58.533409+0000","last_undegraded":"2024-04-25T20:49:58.533409+0000","last_fullsized":"2024-04-25T20:49:58.533409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:27.940615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537703+0000","last_change":"2024-04-25T20:46:25.474253+0000","last_active":"2024-04-25T20:49:58.537703+0000","last_peered":"2024-04-25T20:49:58.537703+0000","last_clean":"2024-04-25T20:49:58.537703+0000","last_became_active":"2024-04-25T20:46:25.473887+0000","last_became_peered":"2024-04-25T20:46:25.473887+0000","last_unstale":"2024-04-25T20:49:58.537703+0000","last_undegraded":"2024-04-25T20:49:58.537703+0000","last_fullsized":"2024-04-25T20:49:58.537703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:59:10.806681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"92'45","reported_seq":486,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:03.785392+0000","last_change":"2024-04-25T20:46:21.431374+0000","last_active":"2024-04-25T20:50:03.785392+0000","last_peered":"2024-04-25T20:50:03.785392+0000","last_clean":"2024-04-25T20:50:03.785392+0000","last_became_active":"2024-04-25T20:46:21.430848+0000","last_became_peered":"2024-04-25T20:46:21.430848+0000","last_unstale":"2024-04-25T20:50:03.785392+0000","last_undegraded":"2024-04-25T20:50:03.785392+0000","last_fullsized":"2024-04-25T20:50:03.785392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:10:03.341175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":278,"num_write":47,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426314+0000","last_change":"2024-04-25T20:46:25.480254+0000","last_active":"2024-04-25T20:49:58.426314+0000","last_peered":"2024-04-25T20:49:58.426314+0000","last_clean":"2024-04-25T20:49:58.426314+0000","last_became_active":"2024-04-25T20:46:25.479886+0000","last_became_peered":"2024-04-25T20:46:25.479886+0000","last_unstale":"2024-04-25T20:49:58.426314+0000","last_undegraded":"2024-04-25T20:49:58.426314+0000","last_fullsized":"2024-04-25T20:49:58.426314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:46.072117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680493+0000","last_change":"2024-04-25T20:46:21.432025+0000","last_active":"2024-04-25T20:49:58.680493+0000","last_peered":"2024-04-25T20:49:58.680493+0000","last_clean":"2024-04-25T20:49:58.680493+0000","last_became_active":"2024-04-25T20:46:21.431520+0000","last_became_peered":"2024-04-25T20:46:21.431520+0000","last_unstale":"2024-04-25T20:49:58.680493+0000","last_undegraded":"2024-04-25T20:49:58.680493+0000","last_fullsized":"2024-04-25T20:49:58.680493+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:48.912240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680951+0000","last_change":"2024-04-25T20:46:25.484799+0000","last_active":"2024-04-25T20:49:58.680951+0000","last_peered":"2024-04-25T20:49:58.680951+0000","last_clean":"2024-04-25T20:49:58.680951+0000","last_became_active":"2024-04-25T20:46:25.484480+0000","last_became_peered":"2024-04-25T20:46:25.484480+0000","last_unstale":"2024-04-25T20:49:58.680951+0000","last_undegraded":"2024-04-25T20:49:58.680951+0000","last_fullsized":"2024-04-25T20:49:58.680951+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:38:39.660911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533011+0000","last_change":"2024-04-25T20:46:21.427520+0000","last_active":"2024-04-25T20:49:58.533011+0000","last_peered":"2024-04-25T20:49:58.533011+0000","last_clean":"2024-04-25T20:49:58.533011+0000","last_became_active":"2024-04-25T20:46:21.427138+0000","last_became_peered":"2024-04-25T20:46:21.427138+0000","last_unstale":"2024-04-25T20:49:58.533011+0000","last_undegraded":"2024-04-25T20:49:58.533011+0000","last_fullsized":"2024-04-25T20:49:58.533011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:41:27.521558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489352+0000","last_change":"2024-04-25T20:46:25.492188+0000","last_active":"2024-04-25T20:49:58.489352+0000","last_peered":"2024-04-25T20:49:58.489352+0000","last_clean":"2024-04-25T20:49:58.489352+0000","last_became_active":"2024-04-25T20:46:25.491858+0000","last_became_peered":"2024-04-25T20:46:25.491858+0000","last_unstale":"2024-04-25T20:49:58.489352+0000","last_undegraded":"2024-04-25T20:49:58.489352+0000","last_fullsized":"2024-04-25T20:49:58.489352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:23:33.338999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"92'8","reported_seq":240,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.870873+0000","last_change":"2024-04-25T20:46:21.431536+0000","last_active":"2024-04-25T20:50:02.870873+0000","last_peered":"2024-04-25T20:50:02.870873+0000","last_clean":"2024-04-25T20:50:02.870873+0000","last_became_active":"2024-04-25T20:46:21.431036+0000","last_became_peered":"2024-04-25T20:46:21.431036+0000","last_unstale":"2024-04-25T20:50:02.870873+0000","last_undegraded":"2024-04-25T20:50:02.870873+0000","last_fullsized":"2024-04-25T20:50:02.870873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:47.076511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489112+0000","last_change":"2024-04-25T20:46:25.480332+0000","last_active":"2024-04-25T20:49:58.489112+0000","last_peered":"2024-04-25T20:49:58.489112+0000","last_clean":"2024-04-25T20:49:58.489112+0000","last_became_active":"2024-04-25T20:46:25.479958+0000","last_became_peered":"2024-04-25T20:46:25.479958+0000","last_unstale":"2024-04-25T20:49:58.489112+0000","last_undegraded":"2024-04-25T20:49:58.489112+0000","last_fullsized":"2024-04-25T20:49:58.489112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:30:31.883219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:21.499088+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:21.498737+0000","last_became_peered":"2024-04-25T20:46:21.498737+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:15.918685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.533010+0000","last_change":"2024-04-25T20:46:25.484159+0000","last_active":"2024-04-25T20:49:58.533010+0000","last_peered":"2024-04-25T20:49:58.533010+0000","last_clean":"2024-04-25T20:49:58.533010+0000","last_became_active":"2024-04-25T20:46:25.483829+0000","last_became_peered":"2024-04-25T20:46:25.483829+0000","last_unstale":"2024-04-25T20:49:58.533010+0000","last_undegraded":"2024-04-25T20:49:58.533010+0000","last_fullsized":"2024-04-25T20:49:58.533010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:13:44.977768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426464+0000","last_change":"2024-04-25T20:46:21.428110+0000","last_active":"2024-04-25T20:49:58.426464+0000","last_peered":"2024-04-25T20:49:58.426464+0000","last_clean":"2024-04-25T20:49:58.426464+0000","last_became_active":"2024-04-25T20:46:21.427552+0000","last_became_peered":"2024-04-25T20:46:21.427552+0000","last_unstale":"2024-04-25T20:49:58.426464+0000","last_undegraded":"2024-04-25T20:49:58.426464+0000","last_fullsized":"2024-04-25T20:49:58.426464+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:04.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517414+0000","last_change":"2024-04-25T20:46:25.491690+0000","last_active":"2024-04-25T20:49:58.517414+0000","last_peered":"2024-04-25T20:49:58.517414+0000","last_clean":"2024-04-25T20:49:58.517414+0000","last_became_active":"2024-04-25T20:46:25.491324+0000","last_became_peered":"2024-04-25T20:46:25.491324+0000","last_unstale":"2024-04-25T20:49:58.517414+0000","last_undegraded":"2024-04-25T20:49:58.517414+0000","last_fullsized":"2024-04-25T20:49:58.517414+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:19:56.840049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424477+0000","last_change":"2024-04-25T20:46:21.498767+0000","last_active":"2024-04-25T20:49:58.424477+0000","last_peered":"2024-04-25T20:49:58.424477+0000","last_clean":"2024-04-25T20:49:58.424477+0000","last_became_active":"2024-04-25T20:46:21.498433+0000","last_became_peered":"2024-04-25T20:46:21.498433+0000","last_unstale":"2024-04-25T20:49:58.424477+0000","last_undegraded":"2024-04-25T20:49:58.424477+0000","last_fullsized":"2024-04-25T20:49:58.424477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:43.409986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535918+0000","last_change":"2024-04-25T20:46:25.493052+0000","last_active":"2024-04-25T20:49:58.535918+0000","last_peered":"2024-04-25T20:49:58.535918+0000","last_clean":"2024-04-25T20:49:58.535918+0000","last_became_active":"2024-04-25T20:46:25.492639+0000","last_became_peered":"2024-04-25T20:46:25.492639+0000","last_unstale":"2024-04-25T20:49:58.535918+0000","last_undegraded":"2024-04-25T20:49:58.535918+0000","last_fullsized":"2024-04-25T20:49:58.535918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:10:02.689897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"92'10","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.791628+0000","last_change":"2024-04-25T20:46:21.428568+0000","last_active":"2024-04-25T20:50:02.791628+0000","last_peered":"2024-04-25T20:50:02.791628+0000","last_clean":"2024-04-25T20:50:02.791628+0000","last_became_active":"2024-04-25T20:46:21.428246+0000","last_became_peered":"2024-04-25T20:46:21.428246+0000","last_unstale":"2024-04-25T20:50:02.791628+0000","last_undegraded":"2024-04-25T20:50:02.791628+0000","last_fullsized":"2024-04-25T20:50:02.791628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:51.545175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":203,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.535813+0000","last_change":"2024-04-25T20:47:05.755662+0000","last_active":"2024-04-25T20:49:58.535813+0000","last_peered":"2024-04-25T20:49:58.535813+0000","last_clean":"2024-04-25T20:49:58.535813+0000","last_became_active":"2024-04-25T20:47:05.755227+0000","last_became_peered":"2024-04-25T20:47:05.755227+0000","last_unstale":"2024-04-25T20:49:58.535813+0000","last_undegraded":"2024-04-25T20:49:58.535813+0000","last_fullsized":"2024-04-25T20:49:58.535813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:43:43.227628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.424272+0000","last_change":"2024-04-25T20:47:05.920287+0000","last_active":"2024-04-25T20:49:58.424272+0000","last_peered":"2024-04-25T20:49:58.424272+0000","last_clean":"2024-04-25T20:49:58.424272+0000","last_became_active":"2024-04-25T20:47:05.919878+0000","last_became_peered":"2024-04-25T20:47:05.919878+0000","last_unstale":"2024-04-25T20:49:58.424272+0000","last_undegraded":"2024-04-25T20:49:58.424272+0000","last_fullsized":"2024-04-25T20:49:58.424272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:36.143996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"92'7","reported_seq":235,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.869797+0000","last_change":"2024-04-25T20:46:21.498497+0000","last_active":"2024-04-25T20:50:02.869797+0000","last_peered":"2024-04-25T20:50:02.869797+0000","last_clean":"2024-04-25T20:50:02.869797+0000","last_became_active":"2024-04-25T20:46:21.498016+0000","last_became_peered":"2024-04-25T20:46:21.498016+0000","last_unstale":"2024-04-25T20:50:02.869797+0000","last_undegraded":"2024-04-25T20:50:02.869797+0000","last_fullsized":"2024-04-25T20:50:02.869797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:06:36.722370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":199,"num_read_kb":199,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527251+0000","last_change":"2024-04-25T20:46:25.490527+0000","last_active":"2024-04-25T20:49:58.527251+0000","last_peered":"2024-04-25T20:49:58.527251+0000","last_clean":"2024-04-25T20:49:58.527251+0000","last_became_active":"2024-04-25T20:46:25.490199+0000","last_became_peered":"2024-04-25T20:46:25.490199+0000","last_unstale":"2024-04-25T20:49:58.527251+0000","last_undegraded":"2024-04-25T20:49:58.527251+0000","last_fullsized":"2024-04-25T20:49:58.527251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:02.051576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429311+0000","last_change":"2024-04-25T20:46:21.427490+0000","last_active":"2024-04-25T20:49:58.429311+0000","last_peered":"2024-04-25T20:49:58.429311+0000","last_clean":"2024-04-25T20:49:58.429311+0000","last_became_active":"2024-04-25T20:46:21.427035+0000","last_became_peered":"2024-04-25T20:46:21.427035+0000","last_unstale":"2024-04-25T20:49:58.429311+0000","last_undegraded":"2024-04-25T20:49:58.429311+0000","last_fullsized":"2024-04-25T20:49:58.429311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:46:35.864527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"92'148","reported_seq":405,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:00.537368+0000","last_change":"2024-04-25T20:44:59.538317+0000","last_active":"2024-04-25T20:50:00.537368+0000","last_peered":"2024-04-25T20:50:00.537368+0000","last_clean":"2024-04-25T20:50:00.537368+0000","last_became_active":"2024-04-25T20:44:59.537906+0000","last_became_peered":"2024-04-25T20:44:59.537906+0000","last_unstale":"2024-04-25T20:50:00.537368+0000","last_undegraded":"2024-04-25T20:50:00.537368+0000","last_fullsized":"2024-04-25T20:50:00.537368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:41:31.396935+0000","last_clean_scrub_stamp":"2024-04-25T20:41:31.396935+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:26:42.024450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680709+0000","last_change":"2024-04-25T20:47:05.754986+0000","last_active":"2024-04-25T20:49:58.680709+0000","last_peered":"2024-04-25T20:49:58.680709+0000","last_clean":"2024-04-25T20:49:58.680709+0000","last_became_active":"2024-04-25T20:47:05.754571+0000","last_became_peered":"2024-04-25T20:47:05.754571+0000","last_unstale":"2024-04-25T20:49:58.680709+0000","last_undegraded":"2024-04-25T20:49:58.680709+0000","last_fullsized":"2024-04-25T20:49:58.680709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:22:59.166042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489331+0000","last_change":"2024-04-25T20:46:21.430367+0000","last_active":"2024-04-25T20:49:58.489331+0000","last_peered":"2024-04-25T20:49:58.489331+0000","last_clean":"2024-04-25T20:49:58.489331+0000","last_became_active":"2024-04-25T20:46:21.429897+0000","last_became_peered":"2024-04-25T20:46:21.429897+0000","last_unstale":"2024-04-25T20:49:58.489331+0000","last_undegraded":"2024-04-25T20:49:58.489331+0000","last_fullsized":"2024-04-25T20:49:58.489331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:26:09.866335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.426353+0000","last_change":"2024-04-25T20:46:21.497877+0000","last_active":"2024-04-25T20:49:58.426353+0000","last_peered":"2024-04-25T20:49:58.426353+0000","last_clean":"2024-04-25T20:49:58.426353+0000","last_became_active":"2024-04-25T20:46:21.497407+0000","last_became_peered":"2024-04-25T20:46:21.497407+0000","last_unstale":"2024-04-25T20:49:58.426353+0000","last_undegraded":"2024-04-25T20:49:58.426353+0000","last_fullsized":"2024-04-25T20:49:58.426353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:30:15.159492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681434+0000","last_change":"2024-04-25T20:46:25.480188+0000","last_active":"2024-04-25T20:49:58.681434+0000","last_peered":"2024-04-25T20:49:58.681434+0000","last_clean":"2024-04-25T20:49:58.681434+0000","last_became_active":"2024-04-25T20:46:25.479849+0000","last_became_peered":"2024-04-25T20:46:25.479849+0000","last_unstale":"2024-04-25T20:49:58.681434+0000","last_undegraded":"2024-04-25T20:49:58.681434+0000","last_fullsized":"2024-04-25T20:49:58.681434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:25:18.439891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'128","reported_seq":282,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:00.996648+0000","last_change":"2024-04-25T20:46:21.426363+0000","last_active":"2024-04-25T20:50:00.996648+0000","last_peered":"2024-04-25T20:50:00.996648+0000","last_clean":"2024-04-25T20:50:00.996648+0000","last_became_active":"2024-04-25T20:46:21.425973+0000","last_became_peered":"2024-04-25T20:46:21.425973+0000","last_unstale":"2024-04-25T20:50:00.996648+0000","last_undegraded":"2024-04-25T20:50:00.996648+0000","last_fullsized":"2024-04-25T20:50:00.996648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:09.998797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":376,"num_write":236,"num_write_kb":1414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.527081+0000","last_change":"2024-04-25T20:46:25.483071+0000","last_active":"2024-04-25T20:49:58.527081+0000","last_peered":"2024-04-25T20:49:58.527081+0000","last_clean":"2024-04-25T20:49:58.527081+0000","last_became_active":"2024-04-25T20:46:25.482408+0000","last_became_peered":"2024-04-25T20:46:25.482408+0000","last_unstale":"2024-04-25T20:49:58.527081+0000","last_undegraded":"2024-04-25T20:49:58.527081+0000","last_fullsized":"2024-04-25T20:49:58.527081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:37.488919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.429515+0000","last_change":"2024-04-25T20:46:21.496678+0000","last_active":"2024-04-25T20:49:58.429515+0000","last_peered":"2024-04-25T20:49:58.429515+0000","last_clean":"2024-04-25T20:49:58.429515+0000","last_became_active":"2024-04-25T20:46:21.496401+0000","last_became_peered":"2024-04-25T20:46:21.496401+0000","last_unstale":"2024-04-25T20:49:58.429515+0000","last_undegraded":"2024-04-25T20:49:58.429515+0000","last_fullsized":"2024-04-25T20:49:58.429515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:19.406691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516900+0000","last_change":"2024-04-25T20:46:25.474040+0000","last_active":"2024-04-25T20:49:58.516900+0000","last_peered":"2024-04-25T20:49:58.516900+0000","last_clean":"2024-04-25T20:49:58.516900+0000","last_became_active":"2024-04-25T20:46:25.473722+0000","last_became_peered":"2024-04-25T20:46:25.473722+0000","last_unstale":"2024-04-25T20:49:58.516900+0000","last_undegraded":"2024-04-25T20:49:58.516900+0000","last_fullsized":"2024-04-25T20:49:58.516900+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:27:18.196368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537491+0000","last_change":"2024-04-25T20:47:05.758571+0000","last_active":"2024-04-25T20:49:58.537491+0000","last_peered":"2024-04-25T20:49:58.537491+0000","last_clean":"2024-04-25T20:49:58.537491+0000","last_became_active":"2024-04-25T20:47:05.755336+0000","last_became_peered":"2024-04-25T20:47:05.755336+0000","last_unstale":"2024-04-25T20:49:58.537491+0000","last_undegraded":"2024-04-25T20:49:58.537491+0000","last_fullsized":"2024-04-25T20:49:58.537491+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:37.992464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.425986+0000","last_change":"2024-04-25T20:46:25.482278+0000","last_active":"2024-04-25T20:49:58.425986+0000","last_peered":"2024-04-25T20:49:58.425986+0000","last_clean":"2024-04-25T20:49:58.425986+0000","last_became_active":"2024-04-25T20:46:25.481893+0000","last_became_peered":"2024-04-25T20:46:25.481893+0000","last_unstale":"2024-04-25T20:49:58.425986+0000","last_undegraded":"2024-04-25T20:49:58.425986+0000","last_fullsized":"2024-04-25T20:49:58.425986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:32.028389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526907+0000","last_change":"2024-04-25T20:46:21.428675+0000","last_active":"2024-04-25T20:49:58.526907+0000","last_peered":"2024-04-25T20:49:58.526907+0000","last_clean":"2024-04-25T20:49:58.526907+0000","last_became_active":"2024-04-25T20:46:21.428191+0000","last_became_peered":"2024-04-25T20:46:21.428191+0000","last_unstale":"2024-04-25T20:49:58.526907+0000","last_undegraded":"2024-04-25T20:49:58.526907+0000","last_fullsized":"2024-04-25T20:49:58.526907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:08:12.811992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517181+0000","last_change":"2024-04-25T20:46:25.477991+0000","last_active":"2024-04-25T20:49:58.517181+0000","last_peered":"2024-04-25T20:49:58.517181+0000","last_clean":"2024-04-25T20:49:58.517181+0000","last_became_active":"2024-04-25T20:46:25.477575+0000","last_became_peered":"2024-04-25T20:46:25.477575+0000","last_unstale":"2024-04-25T20:49:58.517181+0000","last_undegraded":"2024-04-25T20:49:58.517181+0000","last_fullsized":"2024-04-25T20:49:58.517181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.082751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"92'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680315+0000","last_change":"2024-04-25T20:46:21.428845+0000","last_active":"2024-04-25T20:49:58.680315+0000","last_peered":"2024-04-25T20:49:58.680315+0000","last_clean":"2024-04-25T20:49:58.680315+0000","last_became_active":"2024-04-25T20:46:21.428545+0000","last_became_peered":"2024-04-25T20:46:21.428545+0000","last_unstale":"2024-04-25T20:49:58.680315+0000","last_undegraded":"2024-04-25T20:49:58.680315+0000","last_fullsized":"2024-04-25T20:49:58.680315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:44.233298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526892+0000","last_change":"2024-04-25T20:46:25.482754+0000","last_active":"2024-04-25T20:49:58.526892+0000","last_peered":"2024-04-25T20:49:58.526892+0000","last_clean":"2024-04-25T20:49:58.526892+0000","last_became_active":"2024-04-25T20:46:25.482455+0000","last_became_peered":"2024-04-25T20:46:25.482455+0000","last_unstale":"2024-04-25T20:49:58.526892+0000","last_undegraded":"2024-04-25T20:49:58.526892+0000","last_fullsized":"2024-04-25T20:49:58.526892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:01.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517138+0000","last_change":"2024-04-25T20:47:05.760635+0000","last_active":"2024-04-25T20:49:58.517138+0000","last_peered":"2024-04-25T20:49:58.517138+0000","last_clean":"2024-04-25T20:49:58.517138+0000","last_became_active":"2024-04-25T20:47:05.755810+0000","last_became_peered":"2024-04-25T20:47:05.755810+0000","last_unstale":"2024-04-25T20:49:58.517138+0000","last_undegraded":"2024-04-25T20:49:58.517138+0000","last_fullsized":"2024-04-25T20:49:58.517138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:33:23.420414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489363+0000","last_change":"2024-04-25T20:46:25.485383+0000","last_active":"2024-04-25T20:49:58.489363+0000","last_peered":"2024-04-25T20:49:58.489363+0000","last_clean":"2024-04-25T20:49:58.489363+0000","last_became_active":"2024-04-25T20:46:25.485076+0000","last_became_peered":"2024-04-25T20:46:25.485076+0000","last_unstale":"2024-04-25T20:49:58.489363+0000","last_undegraded":"2024-04-25T20:49:58.489363+0000","last_fullsized":"2024-04-25T20:49:58.489363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:57.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"92'9","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:02.791680+0000","last_change":"2024-04-25T20:46:21.497839+0000","last_active":"2024-04-25T20:50:02.791680+0000","last_peered":"2024-04-25T20:50:02.791680+0000","last_clean":"2024-04-25T20:50:02.791680+0000","last_became_active":"2024-04-25T20:46:21.497338+0000","last_became_peered":"2024-04-25T20:46:21.497338+0000","last_unstale":"2024-04-25T20:50:02.791680+0000","last_undegraded":"2024-04-25T20:50:02.791680+0000","last_fullsized":"2024-04-25T20:50:02.791680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:45.817759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2484,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":6,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489597+0000","last_change":"2024-04-25T20:46:25.482143+0000","last_active":"2024-04-25T20:49:58.489597+0000","last_peered":"2024-04-25T20:49:58.489597+0000","last_clean":"2024-04-25T20:49:58.489597+0000","last_became_active":"2024-04-25T20:46:25.481770+0000","last_became_peered":"2024-04-25T20:46:25.481770+0000","last_unstale":"2024-04-25T20:49:58.489597+0000","last_undegraded":"2024-04-25T20:49:58.489597+0000","last_fullsized":"2024-04-25T20:49:58.489597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:30.017728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"92'75","reported_seq":146,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:50:00.991293+0000","last_change":"2024-04-25T20:46:21.429050+0000","last_active":"2024-04-25T20:50:00.991293+0000","last_peered":"2024-04-25T20:50:00.991293+0000","last_clean":"2024-04-25T20:50:00.991293+0000","last_became_active":"2024-04-25T20:46:21.428680+0000","last_became_peered":"2024-04-25T20:46:21.428680+0000","last_unstale":"2024-04-25T20:50:00.991293+0000","last_undegraded":"2024-04-25T20:50:00.991293+0000","last_fullsized":"2024-04-25T20:50:00.991293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:19.778352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":44,"num_write":84,"num_write_kb":1075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489311+0000","last_change":"2024-04-25T20:46:25.489989+0000","last_active":"2024-04-25T20:49:58.489311+0000","last_peered":"2024-04-25T20:49:58.489311+0000","last_clean":"2024-04-25T20:49:58.489311+0000","last_became_active":"2024-04-25T20:46:25.489588+0000","last_became_peered":"2024-04-25T20:46:25.489588+0000","last_unstale":"2024-04-25T20:49:58.489311+0000","last_undegraded":"2024-04-25T20:49:58.489311+0000","last_fullsized":"2024-04-25T20:49:58.489311+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:06:25.908403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681526+0000","last_change":"2024-04-25T20:46:21.431116+0000","last_active":"2024-04-25T20:49:58.681526+0000","last_peered":"2024-04-25T20:49:58.681526+0000","last_clean":"2024-04-25T20:49:58.681526+0000","last_became_active":"2024-04-25T20:46:21.430746+0000","last_became_peered":"2024-04-25T20:46:21.430746+0000","last_unstale":"2024-04-25T20:49:58.681526+0000","last_undegraded":"2024-04-25T20:49:58.681526+0000","last_fullsized":"2024-04-25T20:49:58.681526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:20.413804+0000","last_clean_scrub_stamp":"2024-04-25T20:46:20.413804+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:20.531026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.489644+0000","last_change":"2024-04-25T20:46:25.481439+0000","last_active":"2024-04-25T20:49:58.489644+0000","last_peered":"2024-04-25T20:49:58.489644+0000","last_clean":"2024-04-25T20:49:58.489644+0000","last_became_active":"2024-04-25T20:46:25.480334+0000","last_became_peered":"2024-04-25T20:46:25.480334+0000","last_unstale":"2024-04-25T20:49:58.489644+0000","last_undegraded":"2024-04-25T20:49:58.489644+0000","last_fullsized":"2024-04-25T20:49:58.489644+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:23.057114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517178+0000","last_change":"2024-04-25T20:46:25.488784+0000","last_active":"2024-04-25T20:49:58.517178+0000","last_peered":"2024-04-25T20:49:58.517178+0000","last_clean":"2024-04-25T20:49:58.517178+0000","last_became_active":"2024-04-25T20:46:25.488415+0000","last_became_peered":"2024-04-25T20:46:25.488415+0000","last_unstale":"2024-04-25T20:49:58.517178+0000","last_undegraded":"2024-04-25T20:49:58.517178+0000","last_fullsized":"2024-04-25T20:49:58.517178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:02:21.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680328+0000","last_change":"2024-04-25T20:46:25.482997+0000","last_active":"2024-04-25T20:49:58.680328+0000","last_peered":"2024-04-25T20:49:58.680328+0000","last_clean":"2024-04-25T20:49:58.680328+0000","last_became_active":"2024-04-25T20:46:25.482624+0000","last_became_peered":"2024-04-25T20:46:25.482624+0000","last_unstale":"2024-04-25T20:49:58.680328+0000","last_undegraded":"2024-04-25T20:49:58.680328+0000","last_fullsized":"2024-04-25T20:49:58.680328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:08.202301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680241+0000","last_change":"2024-04-25T20:46:25.484363+0000","last_active":"2024-04-25T20:49:58.680241+0000","last_peered":"2024-04-25T20:49:58.680241+0000","last_clean":"2024-04-25T20:49:58.680241+0000","last_became_active":"2024-04-25T20:46:25.483996+0000","last_became_peered":"2024-04-25T20:46:25.483996+0000","last_unstale":"2024-04-25T20:49:58.680241+0000","last_undegraded":"2024-04-25T20:49:58.680241+0000","last_fullsized":"2024-04-25T20:49:58.680241+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:23.755701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.516505+0000","last_change":"2024-04-25T20:46:25.480571+0000","last_active":"2024-04-25T20:49:58.516505+0000","last_peered":"2024-04-25T20:49:58.516505+0000","last_clean":"2024-04-25T20:49:58.516505+0000","last_became_active":"2024-04-25T20:46:25.480265+0000","last_became_peered":"2024-04-25T20:46:25.480265+0000","last_unstale":"2024-04-25T20:49:58.516505+0000","last_undegraded":"2024-04-25T20:49:58.516505+0000","last_fullsized":"2024-04-25T20:49:58.516505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:06.328395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681247+0000","last_change":"2024-04-25T20:46:25.485749+0000","last_active":"2024-04-25T20:49:58.681247+0000","last_peered":"2024-04-25T20:49:58.681247+0000","last_clean":"2024-04-25T20:49:58.681247+0000","last_became_active":"2024-04-25T20:46:25.485446+0000","last_became_peered":"2024-04-25T20:46:25.485446+0000","last_unstale":"2024-04-25T20:49:58.681247+0000","last_undegraded":"2024-04-25T20:49:58.681247+0000","last_fullsized":"2024-04-25T20:49:58.681247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:57.442557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517378+0000","last_change":"2024-04-25T20:46:25.488584+0000","last_active":"2024-04-25T20:49:58.517378+0000","last_peered":"2024-04-25T20:49:58.517378+0000","last_clean":"2024-04-25T20:49:58.517378+0000","last_became_active":"2024-04-25T20:46:25.488123+0000","last_became_peered":"2024-04-25T20:46:25.488123+0000","last_unstale":"2024-04-25T20:49:58.517378+0000","last_undegraded":"2024-04-25T20:49:58.517378+0000","last_fullsized":"2024-04-25T20:49:58.517378+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:33.725112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680645+0000","last_change":"2024-04-25T20:46:25.482427+0000","last_active":"2024-04-25T20:49:58.680645+0000","last_peered":"2024-04-25T20:49:58.680645+0000","last_clean":"2024-04-25T20:49:58.680645+0000","last_became_active":"2024-04-25T20:46:25.482057+0000","last_became_peered":"2024-04-25T20:46:25.482057+0000","last_unstale":"2024-04-25T20:49:58.680645+0000","last_undegraded":"2024-04-25T20:49:58.680645+0000","last_fullsized":"2024-04-25T20:49:58.680645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:42.153893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526828+0000","last_change":"2024-04-25T20:46:25.483200+0000","last_active":"2024-04-25T20:49:58.526828+0000","last_peered":"2024-04-25T20:49:58.526828+0000","last_clean":"2024-04-25T20:49:58.526828+0000","last_became_active":"2024-04-25T20:46:25.482857+0000","last_became_peered":"2024-04-25T20:46:25.482857+0000","last_unstale":"2024-04-25T20:49:58.526828+0000","last_undegraded":"2024-04-25T20:49:58.526828+0000","last_fullsized":"2024-04-25T20:49:58.526828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:59.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.680693+0000","last_change":"2024-04-25T20:47:06.139166+0000","last_active":"2024-04-25T20:49:58.680693+0000","last_peered":"2024-04-25T20:49:58.680693+0000","last_clean":"2024-04-25T20:49:58.680693+0000","last_became_active":"2024-04-25T20:47:06.138766+0000","last_became_peered":"2024-04-25T20:47:06.138766+0000","last_unstale":"2024-04-25T20:49:58.680693+0000","last_undegraded":"2024-04-25T20:49:58.680693+0000","last_fullsized":"2024-04-25T20:49:58.680693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:32.802874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,3],"acting":[6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.526808+0000","last_change":"2024-04-25T20:46:25.482585+0000","last_active":"2024-04-25T20:49:58.526808+0000","last_peered":"2024-04-25T20:49:58.526808+0000","last_clean":"2024-04-25T20:49:58.526808+0000","last_became_active":"2024-04-25T20:46:25.480547+0000","last_became_peered":"2024-04-25T20:46:25.480547+0000","last_unstale":"2024-04-25T20:49:58.526808+0000","last_undegraded":"2024-04-25T20:49:58.526808+0000","last_fullsized":"2024-04-25T20:49:58.526808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:56:08.817762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.537617+0000","last_change":"2024-04-25T20:46:25.481992+0000","last_active":"2024-04-25T20:49:58.537617+0000","last_peered":"2024-04-25T20:49:58.537617+0000","last_clean":"2024-04-25T20:49:58.537617+0000","last_became_active":"2024-04-25T20:46:25.481595+0000","last_became_peered":"2024-04-25T20:46:25.481595+0000","last_unstale":"2024-04-25T20:49:58.537617+0000","last_undegraded":"2024-04-25T20:49:58.537617+0000","last_fullsized":"2024-04-25T20:49:58.537617+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:01.337995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.681231+0000","last_change":"2024-04-25T20:46:25.485960+0000","last_active":"2024-04-25T20:49:58.681231+0000","last_peered":"2024-04-25T20:49:58.681231+0000","last_clean":"2024-04-25T20:49:58.681231+0000","last_became_active":"2024-04-25T20:46:25.485428+0000","last_became_peered":"2024-04-25T20:46:25.485428+0000","last_unstale":"2024-04-25T20:49:58.681231+0000","last_undegraded":"2024-04-25T20:49:58.681231+0000","last_fullsized":"2024-04-25T20:49:58.681231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:54.083900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T20:49:58.517186+0000","last_change":"2024-04-25T20:46:25.492289+0000","last_active":"2024-04-25T20:49:58.517186+0000","last_peered":"2024-04-25T20:49:58.517186+0000","last_clean":"2024-04-25T20:49:58.517186+0000","last_became_active":"2024-04-25T20:46:25.491898+0000","last_became_peered":"2024-04-25T20:46:25.491898+0000","last_unstale":"2024-04-25T20:49:58.517186+0000","last_undegraded":"2024-04-25T20:49:58.517186+0000","last_fullsized":"2024-04-25T20:49:58.517186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T20:46:24.457932+0000","last_clean_scrub_stamp":"2024-04-25T20:46:24.457932+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:34:36.274861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108354,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":806392,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2505,"num_read_kb":1532,"num_write":576,"num_write_kb":2664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":2419176,"data_compressed":108960,"data_compressed_allocated":147456,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351035,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1007616,"data_stored":493791,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32372,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712780,"statfs":{"total":95995035648,"available":95961886720,"internally_reserved":0,"allocated":1216512,"data_stored":1485619,"data_compressed":56037,"data_compressed_allocated":73728,"data_compressed_original":913408,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776198,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":885623,"data_compressed":22191,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037834,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":886001,"data_compressed":22191,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1081344,"data_stored":1089162,"data_compressed":39013,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462996,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":493829,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1085440,"data_stored":567700,"data_compressed":4717,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1036288,"data_stored":494777,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411434,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1105920,"data_stored":569151,"data_compressed":4717,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149795,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36416,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708736,"statfs":{"total":95995035648,"available":95957745664,"internally_reserved":0,"allocated":1101824,"data_stored":1213397,"data_compressed":37393,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888159,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":492908,"data_compressed":2895,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724634,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1138688,"data_stored":1414444,"data_compressed":54215,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36118,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":76415,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":77866,"data_compressed":1822,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":332674,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19296,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19296,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":403849,"data_compressed":17024,"data_compressed_allocated":24576,"data_compressed_original":315392,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T20:50:09.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:50:09.876 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:10.147 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:09 smithi043 ceph-mon[29167]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 82 op/s 2024-04-25T20:50:10.147 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:09 smithi043 ceph-mon[29167]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:10.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:09 smithi195 ceph-mon[33250]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 82 op/s 2024-04-25T20:50:10.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:09 smithi195 ceph-mon[33250]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:09 smithi112 ceph-mon[32322]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 82 op/s 2024-04-25T20:50:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:09 smithi112 ceph-mon[32322]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.609+0000 7fc5226f6700 1 -- 172.21.15.43:0/2132999893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 msgr2=0x7fc51c102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.609+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2132999893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c102f40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc510009990 tx=0x7fc510009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 -- 172.21.15.43:0/2132999893 shutdown_connections 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2132999893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2132999893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 0x7fc51c10f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2132999893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c102f40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 -- 172.21.15.43:0/2132999893 >> 172.21.15.43:0/2132999893 conn(0x7fc51c079bb0 msgr2=0x7fc51c079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 -- 172.21.15.43:0/2132999893 shutdown_connections 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 -- 172.21.15.43:0/2132999893 wait complete. 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 Processor -- start 2024-04-25T20:50:11.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.610+0000 7fc5226f6700 1 -- start start 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 0x7fc51c075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c0757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c112dc0 con 0x7fc51c102ac0 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c112c40 con 0x7fc51c103480 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc5226f6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c112f40 con 0x7fc51c108a70 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46962/0 (socket says 172.21.15.43:46962) 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 -- 172.21.15.43:0/2416821990 learned_addr learned my addr 172.21.15.43:0/2416821990 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51b7fe700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 0x7fc51c075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc520c93700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c0757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 -- 172.21.15.43:0/2416821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 msgr2=0x7fc51c0757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:11.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c0757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 -- 172.21.15.43:0/2416821990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 msgr2=0x7fc51c075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 0x7fc51c075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 -- 172.21.15.43:0/2416821990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c1a7730 con 0x7fc51c102ac0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc520c93700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.611+0000 7fc51bfff700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b530 tx=0x7fc50c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.612+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c015020 con 0x7fc51c102ac0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.612+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc50c011d00 con 0x7fc51c102ac0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.612+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00f2e0 con 0x7fc51c102ac0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.612+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c1a7a20 con 0x7fc51c102ac0 2024-04-25T20:50:11.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.612+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c1a7ee0 con 0x7fc51c102ac0 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.613+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c069730 con 0x7fc51c102ac0 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.614+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fc50c018020 con 0x7fc51c102ac0 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.614+0000 7fc5197fa700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 0x7fc5040a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.615+0000 7fc51b7fe700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 0x7fc5040a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.615+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fc50c0d05b0 con 0x7fc51c102ac0 2024-04-25T20:50:11.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.615+0000 7fc51b7fe700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 0x7fc5040a6410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b5c0 tx=0x7fc510005960 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:11.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.618+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc50c01f020 con 0x7fc51c102ac0 2024-04-25T20:50:11.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.872+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc51c02df80 con 0x7fc51c102ac0 2024-04-25T20:50:11.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.872+0000 7fc5197fa700 1 -- 172.21.15.43:0/2416821990 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7fc50c09cc10 con 0x7fc51c102ac0 2024-04-25T20:50:11.873 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:11.874 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 msgr2=0x7fc5040a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 0x7fc5040a6410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b5c0 tx=0x7fc510005960 comp rx=0 tx=0).stop 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 msgr2=0x7fc51c074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b530 tx=0x7fc50c00b840 comp rx=0 tx=0).stop 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 shutdown_connections 2024-04-25T20:50:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc5040a3f50 0x7fc5040a6410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc51c108a70 0x7fc51c0757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc51c102ac0 0x7fc51c074d40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 --2- 172.21.15.43:0/2416821990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc51c103480 0x7fc51c075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 >> 172.21.15.43:0/2416821990 conn(0x7fc51c079bb0 msgr2=0x7fc51c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 shutdown_connections 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:11.875+0000 7fc5226f6700 1 -- 172.21.15.43:0/2416821990 wait complete. 2024-04-25T20:50:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:50:12.249 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:11 smithi043 ceph-mon[29167]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 108 KiB/s wr, 71 op/s 2024-04-25T20:50:12.249 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:11 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2416821990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:12.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:11 smithi195 ceph-mon[33250]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 108 KiB/s wr, 71 op/s 2024-04-25T20:50:12.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:11 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2416821990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:11 smithi112 ceph-mon[32322]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 108 KiB/s wr, 71 op/s 2024-04-25T20:50:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:11 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2416821990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:12.630 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:50:12.885 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 -- 172.21.15.43:0/3467959390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 msgr2=0x7f8674101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 --2- 172.21.15.43:0/3467959390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f8674101160 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8664009900 tx=0x7f866402a410 comp rx=0 tx=0).stop 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 -- 172.21.15.43:0/3467959390 shutdown_connections 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 --2- 172.21.15.43:0/3467959390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f867410e930 0x7f8674110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 --2- 172.21.15.43:0/3467959390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86741016a0 0x7f867410e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 --2- 172.21.15.43:0/3467959390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f8674101160 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 -- 172.21.15.43:0/3467959390 >> 172.21.15.43:0/3467959390 conn(0x7f8674077fd0 msgr2=0x7f86740783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 -- 172.21.15.43:0/3467959390 shutdown_connections 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.873+0000 7f86788ae640 1 -- 172.21.15.43:0/3467959390 wait complete. 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 Processor -- start 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 -- start start 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 0x7f86741a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f867410e930 0x7f867419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8674114510 con 0x7f8674100d80 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8674114390 con 0x7f86741016a0 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f86788ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8674114690 con 0x7f867410e930 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f867259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f867259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46988/0 (socket says 172.21.15.43:46988) 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.874+0000 7f867259c640 1 -- 172.21.15.43:0/4189748416 learned_addr learned my addr 172.21.15.43:0/4189748416 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f8672d9d640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f867410e930 0x7f867419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f866bfff640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 0x7f86741a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 -- 172.21.15.43:0/4189748416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f867410e930 msgr2=0x7f867419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f867410e930 0x7f867419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 -- 172.21.15.43:0/4189748416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 msgr2=0x7f86741a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 0x7f86741a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 -- 172.21.15.43:0/4189748416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867419b060 con 0x7f8674100d80 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f866bfff640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 0x7f86741a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f867259c640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8664005ab0 tx=0x7f86640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f866b7fe640 1 -- 172.21.15.43:0/4189748416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866403f030 con 0x7f8674100d80 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867419b2f0 con 0x7f8674100d80 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f866b7fe640 1 -- 172.21.15.43:0/4189748416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8664003ac0 con 0x7f8674100d80 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f866b7fe640 1 -- 172.21.15.43:0/4189748416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664035070 con 0x7f8674100d80 2024-04-25T20:50:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.875+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86741a7520 con 0x7f8674100d80 2024-04-25T20:50:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f866b7fe640 1 -- 172.21.15.43:0/4189748416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f8664042030 con 0x7f8674100d80 2024-04-25T20:50:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 Processor -- start 2024-04-25T20:50:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 -- start start 2024-04-25T20:50:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 0x55fea62762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea6276800 0x55fea6278bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fea61d0970 con 0x55fea626b620 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fea616d4a0 con 0x55fea6276800 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f867b5c6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fea61cc930 con 0x55fea626bf40 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.878+0000 7f866b7fe640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 0x7f86600a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47002/0 (socket says 172.21.15.43:47002) 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 0x55fea62762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 -- 172.21.15.43:0/2342515214 learned_addr learned my addr 172.21.15.43:0/2342515214 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 0x7f86600a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f866b7fe640 1 -- 172.21.15.43:0/4189748416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f86640f10f0 con 0x7f8674100d80 2024-04-25T20:50:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f866bfff640 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea6276800 0x55fea6278bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 -- 172.21.15.43:0/2342515214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea6276800 msgr2=0x55fea6278bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea6276800 0x55fea6278bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 -- 172.21.15.43:0/2342515214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 msgr2=0x55fea626ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 -- 172.21.15.43:0/2342515214 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea5ee3210 con 0x55fea626bf40 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f867259c640 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 0x55fea62762c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86640ee6f0 tx=0x7f866404a8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8c0a95cbe5efab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8672d9d640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 0x7f86600a63a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f866c005c40 tx=0x7f866c009500 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8668ff9640 1 -- 172.21.15.43:0/2342515214 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664049040 con 0x55fea626bf40 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8668ff9640 1 -- 172.21.15.43:0/2342515214 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86640bd640 con 0x55fea626bf40 2024-04-25T20:50:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.879+0000 7f8668ff9640 1 -- 172.21.15.43:0/2342515214 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86640bb310 con 0x55fea626bf40 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 -- 172.21.15.43:0/2342515214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 msgr2=0x55fea62762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 0x55fea62762c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86640ee6f0 tx=0x7f866404a8b0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 -- 172.21.15.43:0/2342515214 shutdown_connections 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea6276800 0x55fea6278bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626bf40 0x55fea62762c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 --2- 172.21.15.43:0/2342515214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea626ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 -- 172.21.15.43:0/2342515214 >> 172.21.15.43:0/2342515214 conn(0x55fea6267b30 msgr2=0x55fea6267f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 -- 172.21.15.43:0/2342515214 shutdown_connections 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.880+0000 7f867b5c6740 1 -- 172.21.15.43:0/2342515214 wait complete. 2024-04-25T20:50:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 -- start start 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 Processor -- start 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 0x55fea6276180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea62739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fea62791f0 con 0x55fea626bf40 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fea616b0b0 con 0x55fea626b620 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fea6279370 con 0x55fea6276800 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867b5c6740 10 client.0 _ll_register_callbacks cb 0x55fea6158d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 0x55fea6276180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47008/0 (socket says 172.21.15.43:47008) 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f867259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 0x55fea6276180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:53804/0 (socket says 172.21.15.43:53804) 2024-04-25T20:50:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 -- 172.21.15.43:0/1523808594 learned_addr learned my addr 172.21.15.43:0/1523808594 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f8672d9d640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea62739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 -- 172.21.15.43:0/1523808594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 msgr2=0x55fea62739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea62739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 -- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 msgr2=0x55fea6276180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 0x55fea6276180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.881+0000 7f866bfff640 1 -- 172.21.15.43:0/1523808594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea5faf620 con 0x55fea626bf40 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f866bfff640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f865c013710 tx=0x7f865c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdab8080168b002 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865c011b90 con 0x55fea626bf40 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f865c011d30 con 0x55fea626bf40 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86640bd640 con 0x55fea626bf40 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f865c005020 con 0x55fea626bf40 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f867b5c6740 10 client.15303 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fea6285110 con 0x55fea626bf40 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86640bd640 con 0x55fea626bf40 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f865c01d400 con 0x55fea626bf40 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f867b5c6740 10 client.15303 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.882+0000 7f867b5c6740 10 client.15303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867b5c6740 20 client.15303 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea6286690 0x55fea6288a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867b5c6740 4 client.15303 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea61de390 con 0x55fea6286690 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867259c640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea6286690 0x55fea6288a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f867259c640 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea6286690 0x55fea6288a80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c683891a31314ba1 server_cookie=47ed9e61e2bd3eb5 in_seq=0 out_seq=0 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.883+0000 7f8659ffb640 10 client.15303 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f8659ffb640 1 -- 172.21.15.43:0/1523808594 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fea61de390 con 0x55fea6286690 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f8659ffb640 10 client.15303 handle_command_reply: tid=0 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 client.15303 shutdown 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 msgr2=0x55fea6273470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f865c013710 tx=0x7f865c009f90 comp rx=0 tx=0).stop 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 shutdown_connections 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea6286690 0x55fea6288a80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea62739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f8659ffb640 0 client.15303 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626bf40 0x55fea6273470 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 --2- 172.21.15.43:0/1523808594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626b620 0x55fea6276180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 >> 172.21.15.43:0/1523808594 conn(0x55fea6267b30 msgr2=0x55fea626d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 shutdown_connections 2024-04-25T20:50:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 1 -- 172.21.15.43:0/1523808594 wait complete. 2024-04-25T20:50:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.884+0000 7f867b5c6740 20 client.15303 trim_cache size 0 max 16384 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 Processor -- start 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 -- start start 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea628e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f86741afe00 con 0x55fea626b620 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86741b1940 con 0x55fea626bf40 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867b5c6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f86741b04d0 con 0x55fea6276800 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f866bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47010/0 (socket says 172.21.15.43:47010) 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867259c640 1 -- 172.21.15.43:0/3887077235 learned_addr learned my addr 172.21.15.43:0/3887077235 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f866bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:53812/0 (socket says 172.21.15.43:53812) 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f8672d9d640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea628e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.900+0000 7f867259c640 1 -- 172.21.15.43:0/3887077235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 msgr2=0x55fea628e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f867259c640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea628e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f867259c640 1 -- 172.21.15.43:0/3887077235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 msgr2=0x55fea6266cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f867259c640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f867259c640 1 -- 172.21.15.43:0/3887077235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6272420 con 0x55fea626b620 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f866bfff640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f8672d9d640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea628e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.901+0000 7f867259c640 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86640ee800 tx=0x7f86640d3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd2bab128754bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.903+0000 7f865bfff640 1 -- 172.21.15.43:0/3887077235 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664049040 con 0x55fea626b620 2024-04-25T20:50:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.903+0000 7f865bfff640 1 -- 172.21.15.43:0/3887077235 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86640da070 con 0x55fea626b620 2024-04-25T20:50:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.903+0000 7f865bfff640 1 -- 172.21.15.43:0/3887077235 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86640b95b0 con 0x55fea626b620 2024-04-25T20:50:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- 172.21.15.43:0/3887077235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 msgr2=0x55fea6281fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86640ee800 tx=0x7f86640d3040 comp rx=0 tx=0).stop 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- 172.21.15.43:0/3887077235 shutdown_connections 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea6276800 0x55fea628e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea6266cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 --2- 172.21.15.43:0/3887077235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea626b620 0x55fea6281fe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- 172.21.15.43:0/3887077235 >> 172.21.15.43:0/3887077235 conn(0x55fea6267b30 msgr2=0x55fea6267f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- 172.21.15.43:0/3887077235 shutdown_connections 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- 172.21.15.43:0/3887077235 wait complete. 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 -- start start 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.904+0000 7f867b5c6740 1 Processor -- start 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f86741b1270 con 0x55fea6276800 2024-04-25T20:50:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f86741b0ba0 con 0x55fea626bf40 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f86741adde0 con 0x55fea626b620 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867b5c6740 10 client.0 _ll_register_callbacks cb 0x7f865c009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f866bfff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867259c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47026/0 (socket says 172.21.15.43:47026) 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 -- 172.21.15.43:0/33333152 learned_addr learned my addr 172.21.15.43:0/33333152 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867259c640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:38430/0 (socket says 172.21.15.43:38430) 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f866bfff640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:53814/0 (socket says 172.21.15.43:53814) 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 -- 172.21.15.43:0/33333152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 msgr2=0x55fea627c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 -- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 msgr2=0x55fea627c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 -- 172.21.15.43:0/33333152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea6273d60 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f866bfff640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f867259c640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8672d9d640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f866c00fc20 tx=0x7f866c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755ae4fdef75ec0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.905+0000 7f8659ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004b20 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f866c004cc0 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86640da070 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f866c005020 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 10 client.15309 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fea62ed020 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86640da070 con 0x55fea6276800 2024-04-25T20:50:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f866c01d040 con 0x55fea6276800 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 10 client.15309 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 10 client.15309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 20 client.15309 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea62ed820 0x55fea62efc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 4 client.15309 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.906+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fea61d8200 con 0x55fea62ed820 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.907+0000 7f867259c640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea62ed820 0x55fea62efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.907+0000 7f8659ffb640 10 client.15309 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.907+0000 7f867259c640 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea62ed820 0x55fea62efc40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4eacebd53ae3694 server_cookie=31af5f589a7c8f58 in_seq=0 out_seq=0 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f8659ffb640 1 -- 172.21.15.43:0/33333152 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fea61d8200 con 0x55fea62ed820 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f8659ffb640 10 client.15309 handle_command_reply: tid=0 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 client.15309 shutdown 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 msgr2=0x55fea627cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f866c00fc20 tx=0x7f866c004a40 comp rx=0 tx=0).stop 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 shutdown_connections 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fea62ed820 0x55fea62efc40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fea6276800 0x55fea627cce0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fea626bf40 0x55fea627c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f8659ffb640 0 client.15309 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 --2- 172.21.15.43:0/33333152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fea626b620 0x55fea627c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 >> 172.21.15.43:0/33333152 conn(0x55fea6267b30 msgr2=0x55fea6266cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 shutdown_connections 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 1 -- 172.21.15.43:0/33333152 wait complete. 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.919+0000 7f867b5c6740 20 client.15309 trim_cache size 0 max 16384 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:50:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 msgr2=0x7f86600a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 0x7f86600a63a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f866c005c40 tx=0x7f866c009500 comp rx=0 tx=0).stop 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 msgr2=0x7f86741a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8664005ab0 tx=0x7f86640040c0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 shutdown_connections 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f86600a3ee0 0x7f86600a63a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f867410e930 0x7f867419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86741016a0 0x7f86741a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 --2- 172.21.15.43:0/4189748416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8674100d80 0x7f86741a06d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 >> 172.21.15.43:0/4189748416 conn(0x7f8674077fd0 msgr2=0x7f867410fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 shutdown_connections 2024-04-25T20:50:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:13.920+0000 7f86788ae640 1 -- 172.21.15.43:0/4189748416 wait complete. 2024-04-25T20:50:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:13 smithi043 ceph-mon[29167]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 65 op/s 2024-04-25T20:50:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:13 smithi195 ceph-mon[33250]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 65 op/s 2024-04-25T20:50:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:13 smithi112 ceph-mon[32322]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 65 op/s 2024-04-25T20:50:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3161236684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806b1f0 msgr2=0x7f60b806b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3161236684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806b1f0 0x7f60b806b670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009990 tx=0x7f60ac009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3161236684 shutdown_connections 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3161236684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806bbb0 0x7f60b810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3161236684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3161236684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806b1f0 0x7f60b806b670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3161236684 >> 172.21.15.43:0/3161236684 conn(0x7f60b80789e0 msgr2=0x7f60b8078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3161236684 shutdown_connections 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.624+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3161236684 wait complete. 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 Processor -- start 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 -- start start 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806b1f0 0x7f60b81019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8112dc0 con 0x7f60b806bbb0 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8112c40 con 0x7f60b8108a60 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60bd8aa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8112f40 con 0x7f60b806b1f0 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60b67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47048/0 (socket says 172.21.15.43:47048) 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.625+0000 7f60b67fc700 1 -- 172.21.15.43:0/3992904792 learned_addr learned my addr 172.21.15.43:0/3992904792 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b6ffd700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806b1f0 0x7f60b81019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b77fe700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 -- 172.21.15.43:0/3992904792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806b1f0 msgr2=0x7f60b81019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806b1f0 0x7f60b81019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 -- 172.21.15.43:0/3992904792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 msgr2=0x7f60b8102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 -- 172.21.15.43:0/3992904792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b81abb20 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b77fe700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60b67fc700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60ac005590 tx=0x7f60ac0055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac027070 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b81abd50 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60ac0040f0 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00f460 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.626+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b81ac1a0 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.627+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b81041a0 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.628+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f60ac02a070 con 0x7f60b806bbb0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.629+0000 7f60bc8a8700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 0x7f60a00a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.629+0000 7f60b6ffd700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 0x7f60a00a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.629+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f60ac0d1bb0 con 0x7f60b806bbb0 2024-04-25T20:50:14.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.629+0000 7f60b6ffd700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 0x7f60a00a6390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60a8005950 tx=0x7f60a800a300 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:14.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.634+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f60ac05eff0 con 0x7f60b806bbb0 2024-04-25T20:50:14.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.887+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60b802df80 con 0x7f60b806bbb0 2024-04-25T20:50:14.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.887+0000 7f60bc8a8700 1 -- 172.21.15.43:0/3992904792 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f60ac013070 con 0x7f60b806bbb0 2024-04-25T20:50:14.888 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:14.888 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:50:14.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.889+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 msgr2=0x7f60a00a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:14.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.889+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 0x7f60a00a6390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60a8005950 tx=0x7f60a800a300 comp rx=0 tx=0).stop 2024-04-25T20:50:14.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.889+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 msgr2=0x7f60b8101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:14.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.889+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f60ac005590 tx=0x7f60ac0055c0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 shutdown_connections 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f60a00a3ed0 0x7f60a00a6390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60b806b1f0 0x7f60b81019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60b8108a60 0x7f60b8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 --2- 172.21.15.43:0/3992904792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60b806bbb0 0x7f60b8101ef0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 >> 172.21.15.43:0/3992904792 conn(0x7f60b80789e0 msgr2=0x7f60b80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 shutdown_connections 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:14.890+0000 7f60bd8aa700 1 -- 172.21.15.43:0/3992904792 wait complete. 2024-04-25T20:50:14.891 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:50:15.260 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:14 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3992904792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:15.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:14 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3992904792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:15.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:14 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3992904792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:15.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T20:50:15.833 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:16.222 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:15 smithi043 ceph-mon[29167]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 67 op/s 2024-04-25T20:50:16.243 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:15 smithi195 ceph-mon[33250]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 67 op/s 2024-04-25T20:50:16.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:15 smithi112 ceph-mon[32322]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 99 KiB/s wr, 67 op/s 2024-04-25T20:50:17.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.546+0000 7f0329bd6700 1 -- 172.21.15.43:0/1316366757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406b170 msgr2=0x7f032406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:17.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.546+0000 7f0329bd6700 1 --2- 172.21.15.43:0/1316366757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406b170 0x7f032406b5f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0318009990 tx=0x7f0318009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 -- 172.21.15.43:0/1316366757 shutdown_connections 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 --2- 172.21.15.43:0/1316366757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0324108a70 0x7f0324108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 --2- 172.21.15.43:0/1316366757 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f032406bb30 0x7f032410f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 --2- 172.21.15.43:0/1316366757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406b170 0x7f032406b5f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 -- 172.21.15.43:0/1316366757 >> 172.21.15.43:0/1316366757 conn(0x7f03240777b0 msgr2=0x7f0324077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 -- 172.21.15.43:0/1316366757 shutdown_connections 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 -- 172.21.15.43:0/1316366757 wait complete. 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.547+0000 7f0329bd6700 1 Processor -- start 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 -- start start 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f032406b170 0x7f0324101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0324108a70 0x7f03241027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0324112d90 con 0x7f032406bb30 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0324112c10 con 0x7f0324108a70 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0329bd6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0324112f10 con 0x7f032406b170 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39496/0 (socket says 172.21.15.43:39496) 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 -- 172.21.15.43:0/4281573001 learned_addr learned my addr 172.21.15.43:0/4281573001 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f03237fe700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f032406b170 0x7f0324101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0323fff700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0324108a70 0x7f03241027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 -- 172.21.15.43:0/4281573001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f032406b170 msgr2=0x7f0324101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f032406b170 0x7f0324101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 -- 172.21.15.43:0/4281573001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0324108a70 msgr2=0x7f03241027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0324108a70 0x7f03241027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.548+0000 7f0322ffd700 1 -- 172.21.15.43:0/4281573001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03241a7710 con 0x7f032406bb30 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0322ffd700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f03180057c0 tx=0x7f03180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:17.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318027070 con 0x7f032406bb30 2024-04-25T20:50:17.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03241a79a0 con 0x7f032406bb30 2024-04-25T20:50:17.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0318004000 con 0x7f032406bb30 2024-04-25T20:50:17.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318022d70 con 0x7f032406bb30 2024-04-25T20:50:17.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.549+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03241a7e50 con 0x7f032406bb30 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.550+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03241041a0 con 0x7f032406bb30 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.551+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f031802a070 con 0x7f032406bb30 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.552+0000 7f0320ff9700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 0x7f030c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.552+0000 7f03237fe700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 0x7f030c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.552+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f03180d18c0 con 0x7f032406bb30 2024-04-25T20:50:17.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.552+0000 7f03237fe700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 0x7f030c0a6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0314007b60 tx=0x7f03140073d0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:17.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.556+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f031805eff0 con 0x7f032406bb30 2024-04-25T20:50:17.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.764+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f032402df80 con 0x7f032406bb30 2024-04-25T20:50:17.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.766+0000 7f0320ff9700 1 -- 172.21.15.43:0/4281573001 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23004 (secure 0 0 0) 0x7f0318013070 con 0x7f032406bb30 2024-04-25T20:50:17.767 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:17.767 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:49:58.419402+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1916899701":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6800/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/3360697116":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/801305986":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/1350680357":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T20:50:17.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 msgr2=0x7f030c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:17.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 0x7f030c0a6390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0314007b60 tx=0x7f03140073d0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 msgr2=0x7f03241022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f03180057c0 tx=0x7f03180057f0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 shutdown_connections 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.768+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f030c0a3ed0 0x7f030c0a6390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f032406b170 0x7f0324101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0324108a70 0x7f03241027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 --2- 172.21.15.43:0/4281573001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f032406bb30 0x7f03241022a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 >> 172.21.15.43:0/4281573001 conn(0x7f03240777b0 msgr2=0x7f03241008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 shutdown_connections 2024-04-25T20:50:17.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:17.769+0000 7f0329bd6700 1 -- 172.21.15.43:0/4281573001 wait complete. 2024-04-25T20:50:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:17 smithi043 ceph-mon[29167]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 101 KiB/s wr, 74 op/s 2024-04-25T20:50:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:17 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4281573001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:50:18.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:17 smithi195 ceph-mon[33250]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 101 KiB/s wr, 74 op/s 2024-04-25T20:50:18.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:17 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4281573001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:50:18.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:17 smithi112 ceph-mon[32322]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 101 KiB/s wr, 74 op/s 2024-04-25T20:50:18.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:17 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4281573001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T20:50:18.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-04-25T20:50:18.718 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:20.258 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:19 smithi043 ceph-mon[29167]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-25T20:50:20.339 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:19 smithi112 ceph-mon[32322]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-25T20:50:20.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:19 smithi195 ceph-mon[33250]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-25T20:50:21.204 INFO:teuthology.orchestra.run.smithi043.stdout:{"run_dir":"/var/run/ceph"} 2024-04-25T20:50:21.204 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-25T20:50:21.205 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 2919 2024-04-25T20:50:21.205 DEBUG:tasks.quiescer:Yielding 2024-04-25T20:50:21.205 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T20:50:21.220 INFO:tasks.workunit:Pulling workunits from ref e221b808d285b9d02e54cc10c53c84188e8e41e3 2024-04-25T20:50:21.220 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T20:50:21.221 INFO:tasks.workunit:timeout=3h 2024-04-25T20:50:21.221 INFO:tasks.workunit:cleanup=True 2024-04-25T20:50:21.221 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T20:50:21.221 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T20:50:21.239 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-04-25 20:47:03.010265189 +0000 2024-04-25T20:50:21.240 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-04-25 20:47:03.010265189 +0000 2024-04-25T20:50:21.240 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-04-25 20:49:56.232543941 +0000 2024-04-25T20:50:21.240 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-04-25 20:47:03.010265189 +0000 2024-04-25T20:50:21.240 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T20:50:21.240 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T20:50:21.314 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e221b808d285b9d02e54cc10c53c84188e8e41e3 2024-04-25T20:50:21.370 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T20:50:21.481 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:22.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:21 smithi043 ceph-mon[29167]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 KiB/s wr, 16 op/s 2024-04-25T20:50:22.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:21 smithi195 ceph-mon[33250]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 KiB/s wr, 16 op/s 2024-04-25T20:50:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:21 smithi112 ceph-mon[32322]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.9 KiB/s wr, 16 op/s 2024-04-25T20:50:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 -- 172.21.15.43:0/4126222899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c107b20 msgr2=0x7f8d1c107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 --2- 172.21.15.43:0/4126222899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c107b20 0x7f8d1c107f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009990 tx=0x7f8d10009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 -- 172.21.15.43:0/4126222899 shutdown_connections 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 --2- 172.21.15.43:0/4126222899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 --2- 172.21.15.43:0/4126222899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c107b20 0x7f8d1c107f00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 --2- 172.21.15.43:0/4126222899 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 0x7f8d1c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 -- 172.21.15.43:0/4126222899 >> 172.21.15.43:0/4126222899 conn(0x7f8d1c076c60 msgr2=0x7f8d1c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 -- 172.21.15.43:0/4126222899 shutdown_connections 2024-04-25T20:50:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.404+0000 7f8d2302c700 1 -- 172.21.15.43:0/4126222899 wait complete. 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 Processor -- start 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 -- start start 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 0x7f8d1c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c107b20 0x7f8d1c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c112d70 con 0x7f8d1c101dc0 2024-04-25T20:50:23.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c112bf0 con 0x7f8d1c101400 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d2302c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c112ef0 con 0x7f8d1c107b20 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39506/0 (socket says 172.21.15.43:39506) 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d1bfff700 1 -- 172.21.15.43:0/1580033648 learned_addr learned my addr 172.21.15.43:0/1580033648 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d20dc8700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 0x7f8d1c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.405+0000 7f8d215c9700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c107b20 0x7f8d1c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 -- 172.21.15.43:0/1580033648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c107b20 msgr2=0x7f8d1c19d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c107b20 0x7f8d1c19d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 -- 172.21.15.43:0/1580033648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 msgr2=0x7f8d1c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 0x7f8d1c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 -- 172.21.15.43:0/1580033648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c19e130 con 0x7f8d1c101dc0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d1bfff700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c9b0 tx=0x7f8d0800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08007b00 con 0x7f8d1c101dc0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d0800ce50 con 0x7f8d1c101dc0 2024-04-25T20:50:23.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c19e420 con 0x7f8d1c101dc0 2024-04-25T20:50:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08018660 con 0x7f8d1c101dc0 2024-04-25T20:50:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.406+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1a5ca0 con 0x7f8d1c101dc0 2024-04-25T20:50:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.407+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c069730 con 0x7f8d1c101dc0 2024-04-25T20:50:23.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.409+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f8d0800f450 con 0x7f8d1c101dc0 2024-04-25T20:50:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.410+0000 7f8d19ffb700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 0x7f8d0c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.410+0000 7f8d20dc8700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 0x7f8d0c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:23.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.410+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f8d080d0cd0 con 0x7f8d1c101dc0 2024-04-25T20:50:23.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.410+0000 7f8d20dc8700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 0x7f8d0c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000b5c0 tx=0x7f8d10005960 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:23.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.413+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8d08014030 con 0x7f8d1c101dc0 2024-04-25T20:50:23.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.735+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d1c19a480 con 0x7f8d1c101dc0 2024-04-25T20:50:23.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.736+0000 7f8d19ffb700 1 -- 172.21.15.43:0/1580033648 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f8d1c19a480 con 0x7f8d1c101dc0 2024-04-25T20:50:23.737 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:50:23.738 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:50:23.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 msgr2=0x7f8d0c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 0x7f8d0c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000b5c0 tx=0x7f8d10005960 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 msgr2=0x7f8d1c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c9b0 tx=0x7f8d0800ccc0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 shutdown_connections 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8d0c0a3ed0 0x7f8d0c0a6390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d1c107b20 0x7f8d1c19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d1c101400 0x7f8d1c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 --2- 172.21.15.43:0/1580033648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c101dc0 0x7f8d1c199660 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 >> 172.21.15.43:0/1580033648 conn(0x7f8d1c076c60 msgr2=0x7f8d1c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 shutdown_connections 2024-04-25T20:50:23.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:23.740+0000 7f8d2302c700 1 -- 172.21.15.43:0/1580033648 wait complete. 2024-04-25T20:50:23.742 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:50:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:23 smithi043 ceph-mon[29167]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-04-25T20:50:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:23 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1580033648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:23 smithi195 ceph-mon[33250]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-04-25T20:50:24.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:23 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1580033648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:23 smithi112 ceph-mon[32322]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-04-25T20:50:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:23 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1580033648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:50:24.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T20:46:27.488319+0000', 'modified': '2024-04-25T20:49:56.955674+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24470, 'mds_1': 24449, 'mds_2': 24448, 'mds_3': 24430, 'mds_4': 24424}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14556': {'gid': 14556, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6839/283016818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6838', 'nonce': 283016818}, {'type': 'v1', 'addr': '172.21.15.43:6839', 'nonce': 283016818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14568': {'gid': 14568, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6841/2354201113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6840', 'nonce': 2354201113}, {'type': 'v1', 'addr': '172.21.15.43:6841', 'nonce': 2354201113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/2602577561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2602577561}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2602577561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6833/2634876322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6832', 'nonce': 2634876322}, {'type': 'v1', 'addr': '172.21.15.112:6833', 'nonce': 2634876322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.112:6835/1792854312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6834', 'nonce': 1792854312}, {'type': 'v1', 'addr': '172.21.15.112:6835', 'nonce': 1792854312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.195:6835/1478210024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 1478210024}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 1478210024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.195:6837/97560283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6836', 'nonce': 97560283}, {'type': 'v1', 'addr': '172.21.15.195:6837', 'nonce': 97560283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.195:6839/4260595708', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 4260595708}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 4260595708}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.112:6837/246583870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6836', 'nonce': 246583870}, {'type': 'v1', 'addr': '172.21.15.112:6837', 'nonce': 246583870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.112:6839/2400080298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 2400080298}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 2400080298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24470, 'qdb_cluster': [24470, 24449, 24448, 24424, 24430]} 2024-04-25T20:50:24.621 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T20:50:24.621 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.f status 2024-04-25T20:50:24.916 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:25 smithi043 ceph-mon[29167]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-04-25T20:50:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:25 smithi195 ceph-mon[33250]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-04-25T20:50:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:25 smithi112 ceph-mon[32322]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-04-25T20:50:26.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/4125542845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406b0f0 msgr2=0x7f1a7410f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/4125542845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406b0f0 0x7f1a7410f900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00b0a0 tx=0x7f1a6c00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/4125542845 shutdown_connections 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/4125542845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 0x7f1a74108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/4125542845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406b0f0 0x7f1a7410f900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/4125542845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406a750 0x7f1a7406abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/4125542845 >> 172.21.15.43:0/4125542845 conn(0x7f1a740788f0 msgr2=0x7f1a74078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/4125542845 shutdown_connections 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.850+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/4125542845 wait complete. 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 Processor -- start 2024-04-25T20:50:26.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 -- start start 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406b0f0 0x7f1a74101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 0x7f1a74102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74112d50 con 0x7f1a7406a750 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74112bd0 con 0x7f1a7406b0f0 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.851+0000 7f1a7b2a4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74112ed0 con 0x7f1a74108a30 2024-04-25T20:50:26.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58104/0 (socket says 172.21.15.43:58104) 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 -- 172.21.15.43:0/626118608 learned_addr learned my addr 172.21.15.43:0/626118608 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a7883f700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406b0f0 0x7f1a74101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79841700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 0x7f1a74102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 -- 172.21.15.43:0/626118608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 msgr2=0x7f1a74102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 0x7f1a74102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 -- 172.21.15.43:0/626118608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406b0f0 msgr2=0x7f1a74101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406b0f0 0x7f1a74101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 -- 172.21.15.43:0/626118608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a741a76a0 con 0x7f1a7406a750 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a79040700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c920 tx=0x7f1a7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a6a7fc700 1 -- 172.21.15.43:0/626118608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70004a30 con 0x7f1a7406a750 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.852+0000 7f1a6a7fc700 1 -- 172.21.15.43:0/626118608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a700054f0 con 0x7f1a7406a750 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.853+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a741a7990 con 0x7f1a7406a750 2024-04-25T20:50:26.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.853+0000 7f1a6a7fc700 1 -- 172.21.15.43:0/626118608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70007cd0 con 0x7f1a7406a750 2024-04-25T20:50:26.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.853+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a741a7f20 con 0x7f1a7406a750 2024-04-25T20:50:26.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.856+0000 7f1a6a7fc700 1 -- 172.21.15.43:0/626118608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f1a70004eb0 con 0x7f1a7406a750 2024-04-25T20:50:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.856+0000 7f1a6a7fc700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 0x7f1a600a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.856+0000 7f1a85b2db80 1 Processor -- start 2024-04-25T20:50:26.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 -- start start 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 0x7f1a600a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a6a7fc700 1 -- 172.21.15.43:0/626118608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f1a700d04c0 con 0x7f1a7406a750 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c57a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57ed90 0x55670c57f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55670c4c3ce0 con 0x55670c579fe0 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55670c46a910 con 0x55670c57a900 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55670c4bfca0 con 0x55670c57ed90 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:54210/0 (socket says 172.21.15.43:54210) 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 -- 172.21.15.43:0/1571086329 learned_addr learned my addr 172.21.15.43:0/1571086329 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:26.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a79040700 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c57a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 0x7f1a600a6410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a74078e60 tx=0x7f1a6400b410 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a79841700 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57ed90 0x55670c57f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 -- 172.21.15.43:0/1571086329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57ed90 msgr2=0x55670c57f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57ed90 0x55670c57f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.857+0000 7f1a7883f700 1 -- 172.21.15.43:0/1571086329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 msgr2=0x55670c57a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c57a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a7883f700 1 -- 172.21.15.43:0/1571086329 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670c411880 con 0x55670c57a900 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a64010f70 tx=0x7f1a64013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707d8cb3434c4205 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a5f7fe700 1 -- 172.21.15.43:0/1571086329 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64011db0 con 0x55670c57a900 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a5f7fe700 1 -- 172.21.15.43:0/1571086329 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a6401e8f0 con 0x55670c57a900 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.858+0000 7f1a5f7fe700 1 -- 172.21.15.43:0/1571086329 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6401d7a0 con 0x55670c57a900 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1571086329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 msgr2=0x55670c57e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a64010f70 tx=0x7f1a64013000 comp rx=0 tx=0).stop 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1571086329 shutdown_connections 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57ed90 0x55670c57f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c57a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1571086329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57a900 0x55670c57e850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1571086329 >> 172.21.15.43:0/1571086329 conn(0x55670c49e640 msgr2=0x55670c56c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1571086329 shutdown_connections 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1571086329 wait complete. 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.859+0000 7f1a85b2db80 1 -- start start 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 Processor -- start 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c579fe0 0x55670c586260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c583aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55670c586dc0 con 0x55670c57a900 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55670c462b80 con 0x55670c57ed90 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55670c586f40 con 0x55670c579fe0 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a85b2db80 10 client.0 _ll_register_callbacks cb 0x55670c45c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:26.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a7883f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a7883f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58130/0 (socket says 172.21.15.43:58130) 2024-04-25T20:50:26.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a7883f700 1 -- 172.21.15.43:0/1140356167 learned_addr learned my addr 172.21.15.43:0/1140356167 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.860+0000 7f1a79841700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c583aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 -- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c579fe0 msgr2=0x55670c586260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a79040700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c579fe0 0x55670c586260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c579fe0 0x55670c586260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 -- 172.21.15.43:0/1140356167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 msgr2=0x55670c583aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c583aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 -- 172.21.15.43:0/1140356167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670c47b220 con 0x55670c57a900 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a79841700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c583aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:26.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a7883f700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400bf70 tx=0x7f1a6401e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ce671b4a6f48bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a5cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6401eaa0 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f1a6401ec40 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a6401e8f0 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a64005040 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a85b2db80 10 client.15339 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55670c591650 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.861+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a6401e8f0 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1a64004c60 con 0x55670c57a900 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 10 client.15339 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 10 client.15339 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 20 client.15339 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:26.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c593940 0x55670c594db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 4 client.15339 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55670c4d14d0 con 0x55670c593940 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.862+0000 7f1a79040700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c593940 0x55670c594db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.863+0000 7f1a5cff9700 10 client.15339 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.863+0000 7f1a79040700 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c593940 0x55670c594db0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f21c639e8332b1cc server_cookie=c73a840e0880b2e5 in_seq=0 out_seq=0 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.863+0000 7f1a5cff9700 1 -- 172.21.15.43:0/1140356167 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55670c4d14d0 con 0x55670c593940 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.863+0000 7f1a5cff9700 10 client.15339 handle_command_reply: tid=0 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.863+0000 7f1a85b2db80 1 client.15339 shutdown 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 msgr2=0x55670c583560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400bf70 tx=0x7f1a6401e420 comp rx=0 tx=0).stop 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 shutdown_connections 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c593940 0x55670c594db0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c579fe0 0x55670c586260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c583aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1140356167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57a900 0x55670c583560 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 >> 172.21.15.43:0/1140356167 conn(0x55670c49e640 msgr2=0x55670c5801f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a5cff9700 0 client.15339 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 shutdown_connections 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1140356167 wait complete. 2024-04-25T20:50:26.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.864+0000 7f1a85b2db80 20 client.15339 trim_cache size 0 max 16384 2024-04-25T20:50:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 Processor -- start 2024-04-25T20:50:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 -- start start 2024-04-25T20:50:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c570b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c571060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55670c5930f0 con 0x55670c579fe0 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.889+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55670c5937c0 con 0x55670c57ed90 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55670c593e90 con 0x55670c57a900 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58138/0 (socket says 172.21.15.43:58138) 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 -- 172.21.15.43:0/1538268637 learned_addr learned my addr 172.21.15.43:0/1538268637 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 -- 172.21.15.43:0/1538268637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 msgr2=0x55670c570b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79841700 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c571060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c570b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 -- 172.21.15.43:0/1538268637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 msgr2=0x55670c571060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c571060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 -- 172.21.15.43:0/1538268637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670c581af0 con 0x55670c579fe0 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79841700 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c571060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a79040700 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1a700cdb20 tx=0x7f1a70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2ad0f0217106b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a5effd700 1 -- 172.21.15.43:0/1538268637 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70085070 con 0x55670c579fe0 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a5effd700 1 -- 172.21.15.43:0/1538268637 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a700a05f0 con 0x55670c579fe0 2024-04-25T20:50:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.890+0000 7f1a5effd700 1 -- 172.21.15.43:0/1538268637 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7001d040 con 0x55670c579fe0 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1538268637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 msgr2=0x55670c5705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1a700cdb20 tx=0x7f1a70000bc0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1538268637 shutdown_connections 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c57ed90 0x55670c571060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c579fe0 0x55670c5705e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/1538268637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c570b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1538268637 >> 172.21.15.43:0/1538268637 conn(0x55670c49e640 msgr2=0x55670c56b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1538268637 shutdown_connections 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.891+0000 7f1a85b2db80 1 -- 172.21.15.43:0/1538268637 wait complete. 2024-04-25T20:50:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 -- start start 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 Processor -- start 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c579fe0 0x55670c598340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c598880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55670c594c30 con 0x55670c57ed90 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55670c594560 con 0x55670c579fe0 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55670c595300 con 0x55670c57a900 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a85b2db80 10 client.0 _ll_register_callbacks cb 0x55670c45c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a79841700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a79841700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58148/0 (socket says 172.21.15.43:58148) 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.892+0000 7f1a79841700 1 -- 172.21.15.43:0/3851860583 learned_addr learned my addr 172.21.15.43:0/3851860583 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79040700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c579fe0 0x55670c598340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 -- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 msgr2=0x55670c598880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c598880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 -- 172.21.15.43:0/3851860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c579fe0 msgr2=0x55670c598340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c579fe0 0x55670c598340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 -- 172.21.15.43:0/3851860583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670c59ce90 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a79841700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c003c30 tx=0x7f1a6c003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcf6e5e97745cff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a5cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0078f0 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f1a6c007a90 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a700a05f0 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.893+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c007c90 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 10 client.15345 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55670c5fb2b0 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a700a05f0 con 0x55670c57ed90 2024-04-25T20:50:26.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1a6c011070 con 0x55670c57ed90 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 10 client.15345 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 10 client.15345 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 20 client.15345 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c5fff10 0x55670c5fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 4 client.15345 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 --> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] -- command(tid 0: {"prefix": "status"}) -- 0x55670c4cb570 con 0x55670c5fff10 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.894+0000 7f1a79040700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c5fff10 0x55670c5fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a79040700 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c5fff10 0x55670c5fec20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=64dc3e26db795a54 server_cookie=11757ddb2b5dc5dd in_seq=0 out_seq=0 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a5cff9700 10 client.15345 ms_handle_connect on v2:172.21.15.195:6834/1478210024 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a5cff9700 1 -- 172.21.15.43:0/3851860583 <== mds.4 v2:172.21.15.195:6834/1478210024 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55670c4cb570 con 0x55670c5fff10 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a5cff9700 10 client.15345 handle_command_reply: tid=0 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 client.15345 shutdown 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 msgr2=0x55670c59c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c003c30 tx=0x7f1a6c003d10 comp rx=0 tx=0).stop 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 shutdown_connections 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:6834/1478210024,v1:172.21.15.195:6835/1478210024] conn(0x55670c5fff10 0x55670c5fec20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55670c57ed90 0x55670c59c8d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55670c579fe0 0x55670c598340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 --2- 172.21.15.43:0/3851860583 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55670c57a900 0x55670c598880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 >> 172.21.15.43:0/3851860583 conn(0x55670c49e640 msgr2=0x55670c5705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.895+0000 7f1a5cff9700 0 client.15345 ms_handle_reset on v2:172.21.15.195:6834/1478210024 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 shutdown_connections 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a85b2db80 1 -- 172.21.15.43:0/3851860583 wait complete. 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a85b2db80 20 client.15345 trim_cache size 0 max 16384 2024-04-25T20:50:26.901 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 4, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24424, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 221.402475084, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 28, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 92, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 274.17434508299999 2024-04-25T20:50:26.902 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 msgr2=0x7f1a600a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 0x7f1a600a6410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a74078e60 tx=0x7f1a6400b410 comp rx=0 tx=0).stop 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 msgr2=0x7f1a74101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c920 tx=0x7f1a7000cc30 comp rx=0 tx=0).stop 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.896+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 shutdown_connections 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f1a600a3f50 0x7f1a600a6410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a74108a30 0x7f1a74102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a7406a750 0x7f1a74101a10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 --2- 172.21.15.43:0/626118608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1a7406b0f0 0x7f1a74101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:26.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 >> 172.21.15.43:0/626118608 conn(0x7f1a740788f0 msgr2=0x7f1a740ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:26.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 shutdown_connections 2024-04-25T20:50:26.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:26.897+0000 7f1a7b2a4700 1 -- 172.21.15.43:0/626118608 wait complete. 2024-04-25T20:50:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- 172.21.15.43:0/890203837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 msgr2=0x7f080810bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 --2- 172.21.15.43:0/890203837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080810bfe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009900 tx=0x7f07f402a510 comp rx=0 tx=0).stop 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- 172.21.15.43:0/890203837 shutdown_connections 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 --2- 172.21.15.43:0/890203837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f080810c520 0x7f080810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 --2- 172.21.15.43:0/890203837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080810bfe0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 --2- 172.21.15.43:0/890203837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f08081031e0 0x7f08081035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- 172.21.15.43:0/890203837 >> 172.21.15.43:0/890203837 conn(0x7f0808077fd0 msgr2=0x7f08080783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- 172.21.15.43:0/890203837 shutdown_connections 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- 172.21.15.43:0/890203837 wait complete. 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 Processor -- start 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.013+0000 7f080ed20640 1 -- start start 2024-04-25T20:50:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 0x7f080819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 0x7f0808198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f08081122f0 con 0x7f0808103b00 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0808112170 con 0x7f08081031e0 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080ed20640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0808112470 con 0x7f080810c520 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58162/0 (socket says 172.21.15.43:58162) 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 -- 172.21.15.43:0/2387493691 learned_addr learned my addr 172.21.15.43:0/2387493691 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080cabc640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 0x7f080819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080d2bd640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 0x7f0808198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 -- 172.21.15.43:0/2387493691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 msgr2=0x7f0808198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 0x7f0808198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 -- 172.21.15.43:0/2387493691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 msgr2=0x7f080819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 0x7f080819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 -- 172.21.15.43:0/2387493691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0808198df0 con 0x7f0808103b00 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080cabc640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 0x7f080819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f080d2bd640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 0x7f0808198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0807fff640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07f4006010 tx=0x7f07f4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.014+0000 7f0805ffb640 1 -- 172.21.15.43:0/2387493691 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f403f070 con 0x7f0808103b00 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.015+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0808199080 con 0x7f0808103b00 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.015+0000 7f0805ffb640 1 -- 172.21.15.43:0/2387493691 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f07f4031e10 con 0x7f0808103b00 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.015+0000 7f0805ffb640 1 -- 172.21.15.43:0/2387493691 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4035030 con 0x7f0808103b00 2024-04-25T20:50:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.015+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a5330 con 0x7f0808103b00 2024-04-25T20:50:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 Processor -- start 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0805ffb640 1 -- 172.21.15.43:0/2387493691 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f07f4042070 con 0x7f0808103b00 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 -- start start 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf7622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf764bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf6bc970 con 0x55b4bf757620 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.017+0000 7f0811a39740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf6594a0 con 0x55b4bf762800 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f0811a39740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf6b8930 con 0x55b4bf757f40 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58178/0 (socket says 172.21.15.43:58178) 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 -- 172.21.15.43:0/2308974459 learned_addr learned my addr 172.21.15.43:0/2308974459 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f0807fff640 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf764bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080cabc640 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf7622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 -- 172.21.15.43:0/2308974459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 msgr2=0x55b4bf7622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf7622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 -- 172.21.15.43:0/2308974459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 msgr2=0x55b4bf764bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf764bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 -- 172.21.15.43:0/2308974459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bf3cf210 con 0x55b4bf757620 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f0805ffb640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 0x7f07f80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080cabc640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 0x7f07f80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f080d2bd640 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0800008d50 tx=0x7f080000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285b81937dc29bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f0805ffb640 1 -- 172.21.15.43:0/2387493691 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f07f40f1460 con 0x7f0808103b00 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f07f2ffd640 1 -- 172.21.15.43:0/2308974459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000f830 con 0x55b4bf757620 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.018+0000 7f07f2ffd640 1 -- 172.21.15.43:0/2308974459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f080000de20 con 0x55b4bf757620 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f07f2ffd640 1 -- 172.21.15.43:0/2308974459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800018e60 con 0x55b4bf757620 2024-04-25T20:50:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 -- 172.21.15.43:0/2308974459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 msgr2=0x55b4bf757a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f080cabc640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 0x7f07f80a63a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b4bf758bc0 tx=0x7f07fc00c330 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0800008d50 tx=0x7f080000d710 comp rx=0 tx=0).stop 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 -- 172.21.15.43:0/2308974459 shutdown_connections 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf764bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf7622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 --2- 172.21.15.43:0/2308974459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf757a00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 -- 172.21.15.43:0/2308974459 >> 172.21.15.43:0/2308974459 conn(0x55b4bf753b30 msgr2=0x55b4bf753f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 -- 172.21.15.43:0/2308974459 shutdown_connections 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.019+0000 7f0811a39740 1 -- 172.21.15.43:0/2308974459 wait complete. 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 -- start start 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 Processor -- start 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757f40 0x55b4bf75f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf762800 0x55b4bf75fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf765430 con 0x55b4bf757620 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf6570b0 con 0x55b4bf757f40 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b4bf7655b0 con 0x55b4bf762800 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f0811a39740 10 client.0 _ll_register_callbacks cb 0x55b4bf644d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f080cabc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f080cabc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58194/0 (socket says 172.21.15.43:58194) 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.020+0000 7f080cabc640 1 -- 172.21.15.43:0/1071949981 learned_addr learned my addr 172.21.15.43:0/1071949981 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080d2bd640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf762800 0x55b4bf75fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f0807fff640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757f40 0x55b4bf75f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 -- 172.21.15.43:0/1071949981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf762800 msgr2=0x55b4bf75fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf762800 0x55b4bf75fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 -- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757f40 msgr2=0x55b4bf75f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757f40 0x55b4bf75f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 -- 172.21.15.43:0/1071949981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bf49b620 con 0x55b4bf757620 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f080cabc640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07fc011e10 tx=0x7f07fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b89ae2e09f4379 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f07e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc01e420 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f07fc01e5c0 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080000de20 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f07fc01e7c0 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f0811a39740 10 client.15357 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.021+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4bf7713e0 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f080000de20 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f07fc02fbd0 con 0x55b4bf757620 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 10 client.15357 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 20 client.15357 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf774c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 4 client.15357 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4bf6ca390 con 0x55b4bf772850 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0807fff640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf774c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f07e7fff640 10 client.15357 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.022+0000 7f0807fff640 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf774c40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=717170515745e8ab server_cookie=503d48308da9086c in_seq=0 out_seq=0 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f07e7fff640 1 -- 172.21.15.43:0/1071949981 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b4bf6ca390 con 0x55b4bf772850 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f07e7fff640 10 client.15357 handle_command_reply: tid=0 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f0811a39740 1 client.15357 shutdown 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 msgr2=0x55b4bf762190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07fc011e10 tx=0x7f07fc0046c0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 shutdown_connections 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf774c40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.023+0000 7f07e7fff640 0 client.15357 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf762800 0x55b4bf75fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757f40 0x55b4bf75f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 --2- 172.21.15.43:0/1071949981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757620 0x55b4bf762190 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 >> 172.21.15.43:0/1071949981 conn(0x55b4bf753b30 msgr2=0x55b4bf759860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 shutdown_connections 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 1 -- 172.21.15.43:0/1071949981 wait complete. 2024-04-25T20:50:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.024+0000 7f0811a39740 20 client.15357 trim_cache size 0 max 16384 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 Processor -- start 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 -- start start 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757620 0x55b4bf76e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf77a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f08081adbf0 con 0x55b4bf762800 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08081af730 con 0x55b4bf757620 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f0811a39740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ae2c0 con 0x55b4bf757f40 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f080d2bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f080d2bd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58198/0 (socket says 172.21.15.43:58198) 2024-04-25T20:50:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.039+0000 7f080d2bd640 1 -- 172.21.15.43:0/1033428172 learned_addr learned my addr 172.21.15.43:0/1033428172 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f0807fff640 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf77a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080cabc640 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757620 0x55b4bf76e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 -- 172.21.15.43:0/1033428172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 msgr2=0x55b4bf77a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf77a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 -- 172.21.15.43:0/1033428172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757620 msgr2=0x55b4bf76e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757620 0x55b4bf76e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 -- 172.21.15.43:0/1033428172 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bf757d70 con 0x55b4bf762800 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f080d2bd640 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0800008d50 tx=0x7f0800005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02439ccd414f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f07f27fc640 1 -- 172.21.15.43:0/1033428172 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800018680 con 0x55b4bf762800 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f07f27fc640 1 -- 172.21.15.43:0/1033428172 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0800028070 con 0x55b4bf762800 2024-04-25T20:50:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.040+0000 7f07f27fc640 1 -- 172.21.15.43:0/1033428172 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800023460 con 0x55b4bf762800 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- 172.21.15.43:0/1033428172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 msgr2=0x55b4bf77aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0800008d50 tx=0x7f0800005fa0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- 172.21.15.43:0/1033428172 shutdown_connections 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf762800 0x55b4bf77aa90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757f40 0x55b4bf77a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 --2- 172.21.15.43:0/1033428172 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf757620 0x55b4bf76e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- 172.21.15.43:0/1033428172 >> 172.21.15.43:0/1033428172 conn(0x55b4bf753b30 msgr2=0x55b4bf752420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- 172.21.15.43:0/1033428172 shutdown_connections 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- 172.21.15.43:0/1033428172 wait complete. 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 -- start start 2024-04-25T20:50:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.041+0000 7f0811a39740 1 Processor -- start 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 0x55b4bf76a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf768180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f08081af060 con 0x55b4bf757f40 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ae990 con 0x55b4bf762800 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f08081abbd0 con 0x55b4bf757620 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0811a39740 10 client.0 _ll_register_callbacks cb 0x7f07fc011ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58210/0 (socket says 172.21.15.43:58210) 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 -- 172.21.15.43:0/196403712 learned_addr learned my addr 172.21.15.43:0/196403712 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f080cabc640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 0x55b4bf76a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f080d2bd640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf768180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 -- 172.21.15.43:0/196403712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 msgr2=0x55b4bf76a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 0x55b4bf76a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 -- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 msgr2=0x55b4bf768180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf768180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 -- 172.21.15.43:0/196403712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bf7686c0 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f080cabc640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 0x55b4bf76a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f080d2bd640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf768180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f0807fff640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f07f40bd240 tx=0x7f07f40bceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba79c9ca398aef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f07e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.042+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4049040 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f07f40b9920 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0800028070 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f07f40c1660 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4bf7d8b30 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0800028070 con 0x55b4bf757f40 2024-04-25T20:50:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f07f40bd510 con 0x55b4bf757f40 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 10 client.15363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 20 client.15363 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf7db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 4 client.15363 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4bf6c4200 con 0x55b4bf772850 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.043+0000 7f080cabc640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf7db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.044+0000 7f080cabc640 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf7db2a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd51f62faaaf8fdb server_cookie=f424fbf77fa4489c in_seq=0 out_seq=0 2024-04-25T20:50:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.044+0000 7f07e7fff640 10 client.15363 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.052+0000 7f07e7fff640 1 -- 172.21.15.43:0/196403712 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4bf6c4200 con 0x55b4bf772850 2024-04-25T20:50:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.052+0000 7f07e7fff640 10 client.15363 handle_command_reply: tid=0 2024-04-25T20:50:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.052+0000 7f0811a39740 1 client.15363 shutdown 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.052+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 msgr2=0x55b4bf767c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.052+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f07f40bd240 tx=0x7f07f40bceb0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 shutdown_connections 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55b4bf772850 0x55b4bf7db2a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b4bf762800 0x55b4bf768180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4bf757f40 0x55b4bf767c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 --2- 172.21.15.43:0/196403712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b4bf757620 0x55b4bf76a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 >> 172.21.15.43:0/196403712 conn(0x55b4bf753b30 msgr2=0x55b4bf752cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f07e7fff640 0 client.15363 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 shutdown_connections 2024-04-25T20:50:27.054 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 1 -- 172.21.15.43:0/196403712 wait complete. 2024-04-25T20:50:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f0811a39740 20 client.15363 trim_cache size 0 max 16384 2024-04-25T20:50:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:50:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:50:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:50:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 msgr2=0x7f07f80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 0x7f07f80a63a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55b4bf758bc0 tx=0x7f07fc00c330 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 msgr2=0x7f080819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07f4006010 tx=0x7f07f4004430 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 shutdown_connections 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.053+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f07f80a3ee0 0x7f07f80a63a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f080810c520 0x7f0808198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0808103b00 0x7f080819e9b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 --2- 172.21.15.43:0/2387493691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f08081031e0 0x7f080819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 >> 172.21.15.43:0/2387493691 conn(0x7f0808077fd0 msgr2=0x7f08080fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 shutdown_connections 2024-04-25T20:50:27.057 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:27.054+0000 7f080ed20640 1 -- 172.21.15.43:0/2387493691 wait complete. 2024-04-25T20:50:27.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-25T20:50:28.007 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:27 smithi043 ceph-mon[29167]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-04-25T20:50:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:27 smithi195 ceph-mon[33250]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-04-25T20:50:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:27 smithi112 ceph-mon[32322]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-04-25T20:50:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 -- 172.21.15.43:0/4112549369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a41022f0 msgr2=0x7f92a410e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 --2- 172.21.15.43:0/4112549369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a41022f0 0x7f92a410e7e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b0a0 tx=0x7f929c00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.108 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:29 smithi043 ceph-mon[29167]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 -- 172.21.15.43:0/4112549369 shutdown_connections 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 --2- 172.21.15.43:0/4112549369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a41022f0 0x7f92a410e7e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 --2- 172.21.15.43:0/4112549369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4107980 0x7f92a4107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 --2- 172.21.15.43:0/4112549369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a4101930 0x7f92a4101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.106+0000 7f92a8c25700 1 -- 172.21.15.43:0/4112549369 >> 172.21.15.43:0/4112549369 conn(0x7f92a40788b0 msgr2=0x7f92a4078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.107+0000 7f92a8c25700 1 -- 172.21.15.43:0/4112549369 shutdown_connections 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.107+0000 7f92a8c25700 1 -- 172.21.15.43:0/4112549369 wait complete. 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.107+0000 7f92a8c25700 1 Processor -- start 2024-04-25T20:50:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 -- start start 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a41022f0 0x7f92a4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4111c60 con 0x7f92a4107980 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4111ae0 con 0x7f92a4101930 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a8c25700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4111de0 con 0x7f92a41022f0 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:54296/0 (socket says 172.21.15.43:54296) 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58232/0 (socket says 172.21.15.43:58232) 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 -- 172.21.15.43:0/2016404964 learned_addr learned my addr 172.21.15.43:0/2016404964 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f929bfff700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a41022f0 0x7f92a4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 -- 172.21.15.43:0/2016404964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a41022f0 msgr2=0x7f92a4198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a41022f0 0x7f92a4198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 -- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 msgr2=0x7f92a419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a259c700 1 -- 172.21.15.43:0/2016404964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a419d000 con 0x7f92a4101930 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.108+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f92a259c700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f929400d950 tx=0x7f929400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f929b7fe700 1 -- 172.21.15.43:0/2016404964 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294016070 con 0x7f92a4101930 2024-04-25T20:50:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a419d2f0 con 0x7f92a4101930 2024-04-25T20:50:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f929b7fe700 1 -- 172.21.15.43:0/2016404964 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f929400fd60 con 0x7f92a4101930 2024-04-25T20:50:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f929b7fe700 1 -- 172.21.15.43:0/2016404964 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929400e610 con 0x7f92a4101930 2024-04-25T20:50:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.109+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a406afb0 con 0x7f92a4101930 2024-04-25T20:50:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.111+0000 7f929b7fe700 1 -- 172.21.15.43:0/2016404964 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f9294019070 con 0x7f92a4101930 2024-04-25T20:50:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.112+0000 7f929b7fe700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 0x7f92900a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.113+0000 7f929bfff700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 0x7f92900a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.113+0000 7f929b7fe700 1 -- 172.21.15.43:0/2016404964 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f92940d0870 con 0x7f92a4101930 2024-04-25T20:50:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.113+0000 7f929bfff700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 0x7f92900a6390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92a4078eb0 tx=0x7f928c009260 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 Processor -- start 2024-04-25T20:50:30.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 -- start start 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe0b0 0x55b094ffe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b095010080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b094f51c40 con 0x55b094ffe9d0 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b094ef88e0 con 0x55b094ffe0b0 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b094f4dc00 con 0x55b09500dc90 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f929bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f929bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58242/0 (socket says 172.21.15.43:58242) 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.114+0000 7f929bfff700 1 -- 172.21.15.43:0/1920938324 learned_addr learned my addr 172.21.15.43:0/1920938324 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f92a259c700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe0b0 0x55b094ffe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b095010080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 -- 172.21.15.43:0/1920938324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 msgr2=0x55b095010080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b095010080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 -- 172.21.15.43:0/1920938324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe0b0 msgr2=0x55b094ffe490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe0b0 0x55b094ffe490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 -- 172.21.15.43:0/1920938324 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b094ebc6f0 con 0x55b094ffe9d0 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b095010080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f929bfff700 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f928c011d50 tx=0x7f928c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f56c09cf3a56cc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f9298ff9700 1 -- 172.21.15.43:0/1920938324 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c00eb20 con 0x55b094ffe9d0 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f9298ff9700 1 -- 172.21.15.43:0/1920938324 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f928c00ecc0 con 0x55b094ffe9d0 2024-04-25T20:50:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.115+0000 7f9298ff9700 1 -- 172.21.15.43:0/1920938324 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c01d790 con 0x55b094ffe9d0 2024-04-25T20:50:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 -- 172.21.15.43:0/1920938324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 msgr2=0x55b09500d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f928c011d50 tx=0x7f928c014000 comp rx=0 tx=0).stop 2024-04-25T20:50:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 -- 172.21.15.43:0/1920938324 shutdown_connections 2024-04-25T20:50:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b095010080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe0b0 0x55b094ffe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/1920938324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe9d0 0x55b09500d750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 -- 172.21.15.43:0/1920938324 >> 172.21.15.43:0/1920938324 conn(0x55b094f2b840 msgr2=0x55b094ffa580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 -- 172.21.15.43:0/1920938324 shutdown_connections 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.116+0000 7f92b34aeb80 1 -- 172.21.15.43:0/1920938324 wait complete. 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 -- start start 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 Processor -- start 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe9d0 0x55b09500a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b09500ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b095010780 con 0x55b094ffe0b0 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b094f0b560 con 0x55b094ffe9d0 2024-04-25T20:50:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b095010900 con 0x55b09500dc90 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92b34aeb80 10 client.0 _ll_register_callbacks cb 0x55b094eea8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92a259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92a259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58246/0 (socket says 172.21.15.43:58246) 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92a259c700 1 -- 172.21.15.43:0/3579326761 learned_addr learned my addr 172.21.15.43:0/3579326761 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b09500ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.117+0000 7f929bfff700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe9d0 0x55b09500a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 -- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 msgr2=0x55b09500ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b09500ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 -- 172.21.15.43:0/3579326761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe9d0 msgr2=0x55b09500a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe9d0 0x55b09500a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 -- 172.21.15.43:0/3579326761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b094e9f880 con 0x55b094ffe0b0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92a259c700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f92940989f0 tx=0x7f929409bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d9262bb94ff2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f9289ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294020070 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f929409c7f0 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928c00ecc0 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f92940a0940 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92b34aeb80 10 client.15375 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.118+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b09501afe0 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f928c00ecc0 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f92940ce0f0 con 0x55b094ffe0b0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 10 client.15375 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 20 client.15375 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b09501d5a0 0x55b09501ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 4 client.15375 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b094f5f430 con 0x55b09501d5a0 2024-04-25T20:50:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.119+0000 7f929bfff700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b09501d5a0 0x55b09501ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.120+0000 7f9289ffb700 10 client.15375 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:50:30.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.120+0000 7f929bfff700 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b09501d5a0 0x55b09501ea10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5dcc96d04e51b095 server_cookie=49d4c14b366a9302 in_seq=0 out_seq=0 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.120+0000 7f9289ffb700 1 -- 172.21.15.43:0/3579326761 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b094f5f430 con 0x55b09501d5a0 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f9289ffb700 10 client.15375 handle_command_reply: tid=0 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 client.15375 shutdown 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 msgr2=0x55b09500d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f92940989f0 tx=0x7f929409bf70 comp rx=0 tx=0).stop 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 shutdown_connections 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b09501d5a0 0x55b09501ea10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f9289ffb700 0 client.15375 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b09500dc90 0x55b09500ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b094ffe0b0 0x55b09500d3c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/3579326761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b094ffe9d0 0x55b09500a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 >> 172.21.15.43:0/3579326761 conn(0x55b094f2b840 msgr2=0x55b094ffa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 shutdown_connections 2024-04-25T20:50:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 1 -- 172.21.15.43:0/3579326761 wait complete. 2024-04-25T20:50:30.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.121+0000 7f92b34aeb80 20 client.15375 trim_cache size 0 max 16384 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 Processor -- start 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 -- start start 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b09500a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09501d5a0 0x55b095027e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b09501cd50 con 0x55b09500dc90 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b09501d420 con 0x55b09501d5a0 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.144+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b09501daf0 con 0x55b094ffe9d0 2024-04-25T20:50:30.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58258/0 (socket says 172.21.15.43:58258) 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 -- 172.21.15.43:0/2619701832 learned_addr learned my addr 172.21.15.43:0/2619701832 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f92a259c700 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b09500a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09501d5a0 0x55b095027e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 -- 172.21.15.43:0/2619701832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 msgr2=0x55b09500a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b09500a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 -- 172.21.15.43:0/2619701832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09501d5a0 msgr2=0x55b095027e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09501d5a0 0x55b095027e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 -- 172.21.15.43:0/2619701832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b095008c30 con 0x55b09500dc90 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f929bfff700 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f928c011d20 tx=0x7f928c01cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bddc56fca4eb4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f928bfff700 1 -- 172.21.15.43:0/2619701832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c00ebe0 con 0x55b09500dc90 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.145+0000 7f928bfff700 1 -- 172.21.15.43:0/2619701832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f928c00ed80 con 0x55b09500dc90 2024-04-25T20:50:30.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f928bfff700 1 -- 172.21.15.43:0/2619701832 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c003e10 con 0x55b09500dc90 2024-04-25T20:50:30.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 -- 172.21.15.43:0/2619701832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 msgr2=0x55b09500abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f928c011d20 tx=0x7f928c01cf50 comp rx=0 tx=0).stop 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 -- 172.21.15.43:0/2619701832 shutdown_connections 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b09500a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09501d5a0 0x55b095027e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/2619701832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09500dc90 0x55b09500abc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 -- 172.21.15.43:0/2619701832 >> 172.21.15.43:0/2619701832 conn(0x55b094f2b840 msgr2=0x55b094ff9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 -- 172.21.15.43:0/2619701832 shutdown_connections 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.146+0000 7f92b34aeb80 1 -- 172.21.15.43:0/2619701832 wait complete. 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 -- start start 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 Processor -- start 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b095027e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09500dc90 0x55b0950283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b09501e890 con 0x55b09501d5a0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b09501e1c0 con 0x55b09500dc90 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55b09501ef60 con 0x55b094ffe9d0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92b34aeb80 10 client.0 _ll_register_callbacks cb 0x55b094eea8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58274/0 (socket says 172.21.15.43:58274) 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92a2d9d700 1 -- 172.21.15.43:0/319691575 learned_addr learned my addr 172.21.15.43:0/319691575 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.147+0000 7f92a259c700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b095027e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f929bfff700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09500dc90 0x55b0950283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 -- 172.21.15.43:0/319691575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09500dc90 msgr2=0x55b0950283d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09500dc90 0x55b0950283d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 -- 172.21.15.43:0/319691575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 msgr2=0x55b095020e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 -- 172.21.15.43:0/319691575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b095021670 con 0x55b094ffe9d0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a2d9d700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92a259c700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b095027e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9294000c00 tx=0x7f9294005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7366b484ea11fc10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f9289ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:50:30.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294020070 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928c00ed80 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f929409c7f0 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.148+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f92940cdd50 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 10 client.25030 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b095085210 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f928c00ed80 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f92940982e0 con 0x55b094ffe9d0 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 10 client.25030 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 10 client.25030 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 20 client.25030 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b095089d70 0x55b095088a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 4 client.25030 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 --> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] -- command(tid 0: {"prefix": "status"}) -- 0x55b094f594d0 con 0x55b095089d70 2024-04-25T20:50:30.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.149+0000 7f929bfff700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b095089d70 0x55b095088a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f9289ffb700 10 client.25030 ms_handle_connect on v2:172.21.15.195:6836/97560283 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f929bfff700 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b095089d70 0x55b095088a80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5bf5f20eeff70a43 server_cookie=8d0c1919f659ebbd in_seq=0 out_seq=0 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f9289ffb700 1 -- 172.21.15.43:0/319691575 <== mds.3 v2:172.21.15.195:6836/97560283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b094f594d0 con 0x55b095089d70 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f9289ffb700 10 client.25030 handle_command_reply: tid=0 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 client.25030 shutdown 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 msgr2=0x55b095027e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b095027e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9294000c00 tx=0x7f9294005910 comp rx=0 tx=0).stop 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 shutdown_connections 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:6836/97560283,v1:172.21.15.195:6837/97560283] conn(0x55b095089d70 0x55b095088a80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b094ffe9d0 0x55b095027e90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f9289ffb700 0 client.25030 ms_handle_reset on v2:172.21.15.195:6836/97560283 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b09501d5a0 0x55b095020e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 --2- 172.21.15.43:0/319691575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b09500dc90 0x55b0950283d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.150+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 >> 172.21.15.43:0/319691575 conn(0x55b094f2b840 msgr2=0x55b09500a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 shutdown_connections 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92b34aeb80 1 -- 172.21.15.43:0/319691575 wait complete. 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92b34aeb80 20 client.25030 trim_cache size 0 max 16384 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 3, 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24430, 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 225.67193576899999, 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 28, 2024-04-25T20:50:30.156 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 92, 2024-04-25T20:50:30.157 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T20:50:30.157 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 274.62362247499999 2024-04-25T20:50:30.157 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:50:30.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 msgr2=0x7f92900a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 0x7f92900a6390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92a4078eb0 tx=0x7f928c009260 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 msgr2=0x7f92a4197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f929400d950 tx=0x7f929400dc60 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 shutdown_connections 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f92900a3ed0 0x7f92900a6390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92a4107980 0x7f92a419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92a4101930 0x7f92a4197ff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 --2- 172.21.15.43:0/2016404964 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92a41022f0 0x7f92a4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.151+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 >> 172.21.15.43:0/2016404964 conn(0x7f92a40788b0 msgr2=0x7f92a4100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.152+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 shutdown_connections 2024-04-25T20:50:30.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:30.152+0000 7f92a8c25700 1 -- 172.21.15.43:0/2016404964 wait complete. 2024-04-25T20:50:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:29 smithi195 ceph-mon[33250]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T20:50:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:29 smithi112 ceph-mon[32322]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T20:50:30.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-25T20:50:31.220 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:32.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:31 smithi043 ceph-mon[29167]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-04-25T20:50:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:31 smithi195 ceph-mon[33250]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-04-25T20:50:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:31 smithi112 ceph-mon[32322]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-04-25T20:50:33.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 -- 172.21.15.43:0/1254042441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 msgr2=0x7eff6810e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 --2- 172.21.15.43:0/1254042441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff6810e760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7eff6000b0a0 tx=0x7eff6000b3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 -- 172.21.15.43:0/1254042441 shutdown_connections 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 --2- 172.21.15.43:0/1254042441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff6810e760 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 --2- 172.21.15.43:0/1254042441 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 0x7eff68107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 --2- 172.21.15.43:0/1254042441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.044+0000 7eff6d601700 1 -- 172.21.15.43:0/1254042441 >> 172.21.15.43:0/1254042441 conn(0x7eff680fd3c0 msgr2=0x7eff680ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.045+0000 7eff6d601700 1 -- 172.21.15.43:0/1254042441 shutdown_connections 2024-04-25T20:50:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.045+0000 7eff6d601700 1 -- 172.21.15.43:0/1254042441 wait complete. 2024-04-25T20:50:33.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.045+0000 7eff6d601700 1 Processor -- start 2024-04-25T20:50:33.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 -- start start 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 0x7eff6819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff68111bc0 con 0x7eff68102250 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff68111a40 con 0x7eff68107890 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff6d601700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7eff68111d40 con 0x7eff68101890 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff667fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff667fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58292/0 (socket says 172.21.15.43:58292) 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff667fc700 1 -- 172.21.15.43:0/3071850578 learned_addr learned my addr 172.21.15.43:0/3071850578 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff66ffd700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.046+0000 7eff677fe700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 0x7eff6819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 -- 172.21.15.43:0/3071850578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 msgr2=0x7eff68197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 -- 172.21.15.43:0/3071850578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 msgr2=0x7eff6819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 0x7eff6819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 -- 172.21.15.43:0/3071850578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6819cfe0 con 0x7eff68102250 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff66ffd700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff667fc700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098f0 tx=0x7eff5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff4ffff700 1 -- 172.21.15.43:0/3071850578 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00d020 con 0x7eff68102250 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6819d2d0 con 0x7eff68102250 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff4ffff700 1 -- 172.21.15.43:0/3071850578 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff5c00d1c0 con 0x7eff68102250 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6806a720 con 0x7eff68102250 2024-04-25T20:50:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.047+0000 7eff4ffff700 1 -- 172.21.15.43:0/3071850578 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00c460 con 0x7eff68102250 2024-04-25T20:50:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.049+0000 7eff4ffff700 1 -- 172.21.15.43:0/3071850578 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7eff5c01f020 con 0x7eff68102250 2024-04-25T20:50:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.050+0000 7eff4ffff700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 0x7eff500a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.050+0000 7eff66ffd700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 0x7eff500a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.050+0000 7eff4ffff700 1 -- 172.21.15.43:0/3071850578 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7eff5c0d19d0 con 0x7eff68102250 2024-04-25T20:50:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.051+0000 7eff66ffd700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 0x7eff500a6390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff58005950 tx=0x7eff5800b410 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.052+0000 7eff77e8ab80 1 Processor -- start 2024-04-25T20:50:33.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.052+0000 7eff77e8ab80 1 -- start start 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.052+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.052+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1ef530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.052+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56430d137c40 con 0x56430d1e42a0 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56430d0de8e0 con 0x56430d1efa70 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56430d133c00 con 0x56430d1e4bc0 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58308/0 (socket says 172.21.15.43:58308) 2024-04-25T20:50:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 -- 172.21.15.43:0/1576729554 learned_addr learned my addr 172.21.15.43:0/1576729554 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff667fc700 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff677fe700 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 -- 172.21.15.43:0/1576729554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 msgr2=0x56430d1ef530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1ef530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 -- 172.21.15.43:0/1576729554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 msgr2=0x56430d1f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 -- 172.21.15.43:0/1576729554 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430d0a26f0 con 0x56430d1e42a0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff66ffd700 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff58011760 tx=0x7eff58013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f2f4b07f72cfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff4d7fa700 1 -- 172.21.15.43:0/1576729554 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5801e420 con 0x56430d1e42a0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff4d7fa700 1 -- 172.21.15.43:0/1576729554 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff5801ea90 con 0x56430d1e42a0 2024-04-25T20:50:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.053+0000 7eff4d7fa700 1 -- 172.21.15.43:0/1576729554 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5801cc60 con 0x56430d1e42a0 2024-04-25T20:50:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 -- 172.21.15.43:0/1576729554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 msgr2=0x56430d1e4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff58011760 tx=0x7eff58013000 comp rx=0 tx=0).stop 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 -- 172.21.15.43:0/1576729554 shutdown_connections 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e4680 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/1576729554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1ef530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 -- 172.21.15.43:0/1576729554 >> 172.21.15.43:0/1576729554 conn(0x56430d111840 msgr2=0x56430d1e07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 -- 172.21.15.43:0/1576729554 shutdown_connections 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.054+0000 7eff77e8ab80 1 -- 172.21.15.43:0/1576729554 wait complete. 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 -- start start 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 Processor -- start 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e4bc0 0x56430d1ec390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56430d1f2590 con 0x56430d1e42a0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56430d0f1560 con 0x56430d1e4bc0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56430d1f2710 con 0x56430d1efa70 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58320/0 (socket says 172.21.15.43:58320) 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff77e8ab80 10 client.0 _ll_register_callbacks cb 0x56430d0d08d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.055+0000 7eff66ffd700 1 -- 172.21.15.43:0/281254032 learned_addr learned my addr 172.21.15.43:0/281254032 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff667fc700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e4bc0 0x56430d1ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff677fe700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 -- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 msgr2=0x56430d1ec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ec8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 -- 172.21.15.43:0/281254032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e4bc0 msgr2=0x56430d1ec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e4bc0 0x56430d1ec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 -- 172.21.15.43:0/281254032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430d085880 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff66ffd700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7eff5801c760 tx=0x7eff5801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f006e57ae9700ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58036060 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7eff5801e630 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.056+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff5801ea90 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff5801e830 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 10 client.15393 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56430d1fcd80 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff5801ea90 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7eff58026ab0 con 0x56430d1e42a0 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 10 client.15393 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:50:33.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 20 client.15393 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d1ff790 0x56430d200c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 4 client.15393 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.057+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56430d145430 con 0x56430d1ff790 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.058+0000 7eff667fc700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d1ff790 0x56430d200c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.058+0000 7eff667fc700 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d1ff790 0x56430d200c00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a516930e45e3077 server_cookie=2a5201943283df7d in_seq=0 out_seq=0 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.058+0000 7eff4aff5700 10 client.15393 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff4aff5700 1 -- 172.21.15.43:0/281254032 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56430d145430 con 0x56430d1ff790 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff4aff5700 10 client.15393 handle_command_reply: tid=0 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 client.15393 shutdown 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 msgr2=0x56430d1ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7eff5801c760 tx=0x7eff5801c3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 shutdown_connections 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d1ff790 0x56430d200c00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1ef090 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/281254032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e4bc0 0x56430d1ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 >> 172.21.15.43:0/281254032 conn(0x56430d111840 msgr2=0x56430d1e03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff4aff5700 0 client.15393 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 shutdown_connections 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 1 -- 172.21.15.43:0/281254032 wait complete. 2024-04-25T20:50:33.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.059+0000 7eff77e8ab80 20 client.15393 trim_cache size 0 max 16384 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 Processor -- start 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 -- start start 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e42a0 0x56430d1fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56430d1fef40 con 0x56430d1e4bc0 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56430d1ff610 con 0x56430d1e42a0 2024-04-25T20:50:33.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56430d1ffce0 con 0x56430d1efa70 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff667fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff667fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58328/0 (socket says 172.21.15.43:58328) 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff667fc700 1 -- 172.21.15.43:0/2536033276 learned_addr learned my addr 172.21.15.43:0/2536033276 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.080+0000 7eff677fe700 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff66ffd700 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e42a0 0x56430d1fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 -- 172.21.15.43:0/2536033276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 msgr2=0x56430d1ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 -- 172.21.15.43:0/2536033276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e42a0 msgr2=0x56430d1fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e42a0 0x56430d1fe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 -- 172.21.15.43:0/2536033276 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430d1e1a50 con 0x56430d1e4bc0 2024-04-25T20:50:33.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff667fc700 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7eff5c09d450 tx=0x7eff5c00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14db2b522e861465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff4cff9700 1 -- 172.21.15.43:0/2536033276 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c01c040 con 0x56430d1e4bc0 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff4cff9700 1 -- 172.21.15.43:0/2536033276 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff5c0880b0 con 0x56430d1e4bc0 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.081+0000 7eff4cff9700 1 -- 172.21.15.43:0/2536033276 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0a6190 con 0x56430d1e4bc0 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2536033276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 msgr2=0x56430d1e0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7eff5c09d450 tx=0x7eff5c00f040 comp rx=0 tx=0).stop 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2536033276 shutdown_connections 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1efa70 0x56430d1ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1e42a0 0x56430d1fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2536033276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e4bc0 0x56430d1e0960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2536033276 >> 172.21.15.43:0/2536033276 conn(0x56430d111840 msgr2=0x56430d1edbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2536033276 shutdown_connections 2024-04-25T20:50:33.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2536033276 wait complete. 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.082+0000 7eff77e8ab80 1 -- start start 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 Processor -- start 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56430d200a80 con 0x56430d1e42a0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56430d2003b0 con 0x56430d1efa70 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56430d201150 con 0x56430d1e4bc0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff77e8ab80 10 client.0 _ll_register_callbacks cb 0x56430d0d08d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:45776/0 (socket says 172.21.15.43:45776) 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff677fe700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff667fc700 1 -- 172.21.15.43:0/2786675891 learned_addr learned my addr 172.21.15.43:0/2786675891 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58342/0 (socket says 172.21.15.43:58342) 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 -- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 msgr2=0x56430d1e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 -- 172.21.15.43:0/2786675891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 msgr2=0x56430d1e6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1e6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff66ffd700 1 -- 172.21.15.43:0/2786675891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430d209230 con 0x56430d1e42a0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff677fe700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.083+0000 7eff667fc700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff66ffd700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff58026eb0 tx=0x7eff5801aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88641629a447fbf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58036040 con 0x56430d1e42a0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7eff5801e630 con 0x56430d1e42a0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff5c0880b0 con 0x56430d1e42a0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff5801c420 con 0x56430d1e42a0 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff77e8ab80 10 client.15399 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:33.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56430d20a510 con 0x56430d1e42a0 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.084+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff5c0880b0 con 0x56430d1e42a0 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7eff5801c790 con 0x56430d1e42a0 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 10 client.15399 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 20 client.15399 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d26ae70 0x56430d269b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 4 client.15399 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 --> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] -- command(tid 0: {"prefix": "status"}) -- 0x56430d13f4d0 con 0x56430d26ae70 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff667fc700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d26ae70 0x56430d269b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff4aff5700 10 client.15399 ms_handle_connect on v2:172.21.15.195:6838/4260595708 2024-04-25T20:50:33.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.085+0000 7eff667fc700 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d26ae70 0x56430d269b80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c43cfc05ee9edca server_cookie=5a10aede924fcacc in_seq=0 out_seq=0 2024-04-25T20:50:33.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff4aff5700 1 -- 172.21.15.43:0/2786675891 <== mds.2 v2:172.21.15.195:6838/4260595708 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56430d13f4d0 con 0x56430d26ae70 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff4aff5700 10 client.15399 handle_command_reply: tid=0 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 client.15399 shutdown 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 msgr2=0x56430d1e6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff58026eb0 tx=0x7eff5801aed0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 shutdown_connections 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:6838/4260595708,v1:172.21.15.195:6839/4260595708] conn(0x56430d26ae70 0x56430d269b80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56430d1efa70 0x56430d1e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56430d1e42a0 0x56430d1e6240 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 --2- 172.21.15.43:0/2786675891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56430d1e4bc0 0x56430d1e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 >> 172.21.15.43:0/2786675891 conn(0x56430d111840 msgr2=0x56430d1fb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff4aff5700 0 client.15399 ms_handle_reset on v2:172.21.15.195:6838/4260595708 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 shutdown_connections 2024-04-25T20:50:33.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 1 -- 172.21.15.43:0/2786675891 wait complete. 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.086+0000 7eff77e8ab80 20 client.15399 trim_cache size 0 max 16384 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 2, 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24448, 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:50:33.092 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 229.611935966, 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 28, 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 92, 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 271.53702608899999 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 msgr2=0x7eff500a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 0x7eff500a6390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff58005950 tx=0x7eff5800b410 comp rx=0 tx=0).stop 2024-04-25T20:50:33.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 msgr2=0x7eff68198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098f0 tx=0x7eff5c009c00 comp rx=0 tx=0).stop 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 shutdown_connections 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7eff500a3ed0 0x7eff500a6390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff68101890 0x7eff68197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff68107890 0x7eff6819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 --2- 172.21.15.43:0/3071850578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff68102250 0x7eff68198510 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 >> 172.21.15.43:0/3071850578 conn(0x7eff680fd3c0 msgr2=0x7eff680fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 shutdown_connections 2024-04-25T20:50:33.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:33.087+0000 7eff6d601700 1 -- 172.21.15.43:0/3071850578 wait complete. 2024-04-25T20:50:34.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:33 smithi043 ceph-mon[29167]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-04-25T20:50:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:33 smithi195 ceph-mon[33250]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-04-25T20:50:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:33 smithi112 ceph-mon[32322]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-04-25T20:50:36.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:35 smithi043 ceph-mon[29167]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-04-25T20:50:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:35 smithi195 ceph-mon[33250]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-04-25T20:50:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:35 smithi112 ceph-mon[32322]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-04-25T20:50:37.479 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-25T20:50:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:37 smithi043 ceph-mon[29167]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-25T20:50:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:37 smithi195 ceph-mon[33250]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-25T20:50:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:37 smithi112 ceph-mon[32322]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-25T20:50:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 -- 172.21.15.43:0/590927847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb560103b00 msgr2=0x7fb56010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 --2- 172.21.15.43:0/590927847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb560103b00 0x7fb56010bfe0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb554009900 tx=0x7fb55402a510 comp rx=0 tx=0).stop 2024-04-25T20:50:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 -- 172.21.15.43:0/590927847 shutdown_connections 2024-04-25T20:50:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 --2- 172.21.15.43:0/590927847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 0x7fb56010e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 --2- 172.21.15.43:0/590927847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb560103b00 0x7fb56010bfe0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 --2- 172.21.15.43:0/590927847 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb5601031e0 0x7fb5601035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 -- 172.21.15.43:0/590927847 >> 172.21.15.43:0/590927847 conn(0x7fb560077fd0 msgr2=0x7fb5600783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 -- 172.21.15.43:0/590927847 shutdown_connections 2024-04-25T20:50:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.163+0000 7fb565f07640 1 -- 172.21.15.43:0/590927847 wait complete. 2024-04-25T20:50:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.164+0000 7fb565f07640 1 Processor -- start 2024-04-25T20:50:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.164+0000 7fb565f07640 1 -- start start 2024-04-25T20:50:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 0x7fb56019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 0x7fb5601985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39390/0 (socket says 172.21.15.43:39390) 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3641426612 learned_addr learned my addr 172.21.15.43:0/3641426612 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb560112340 con 0x7fb5601031e0 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb5601121c0 con 0x7fb560103b00 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb5601124c0 con 0x7fb56010c520 2024-04-25T20:50:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55effd640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 0x7fb56019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55ffff640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 0x7fb5601985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3641426612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 msgr2=0x7fb5601985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 0x7fb5601985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3641426612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 msgr2=0x7fb56019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 0x7fb56019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb560198d20 con 0x7fb5601031e0 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.165+0000 7fb55effd640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 0x7fb56019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb55000d950 tx=0x7fb55000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb55cff9640 1 -- 172.21.15.43:0/3641426612 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550017070 con 0x7fb5601031e0 2024-04-25T20:50:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb560199010 con 0x7fb5601031e0 2024-04-25T20:50:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb55cff9640 1 -- 172.21.15.43:0/3641426612 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb550009c30 con 0x7fb5601031e0 2024-04-25T20:50:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5601a52b0 con 0x7fb5601031e0 2024-04-25T20:50:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.166+0000 7fb55cff9640 1 -- 172.21.15.43:0/3641426612 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55000f6b0 con 0x7fb5601031e0 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 Processor -- start 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 -- start start 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf97aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb55cff9640 1 -- 172.21.15.43:0/3641426612 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fb550010460 con 0x7fb5601031e0 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf987bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf8df970 con 0x55fbbf97af40 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf87c4a0 con 0x55fbbf985800 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb568c1a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf8db930 con 0x55fbbf97a620 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb55f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf97aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.169+0000 7fb55f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39404/0 (socket says 172.21.15.43:39404) 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3154537192 learned_addr learned my addr 172.21.15.43:0/3154537192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55effd640 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf987bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3154537192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 msgr2=0x55fbbf97aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf97aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3154537192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 msgr2=0x55fbbf987bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf987bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 -- 172.21.15.43:0/3154537192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbf5f2210 con 0x55fbbf97af40 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55cff9640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 0x7fb5480a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.170+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb5500cdcc0 tx=0x7fb5500d8650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609cdfecb3f06b35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.171+0000 7fb55ffff640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 0x7fb5480a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.171+0000 7fb55cff9640 1 -- 172.21.15.43:0/3641426612 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb5500d05b0 con 0x7fb5601031e0 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.171+0000 7fb545ffb640 1 -- 172.21.15.43:0/3154537192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5500985d0 con 0x55fbbf97af40 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.171+0000 7fb545ffb640 1 -- 172.21.15.43:0/3154537192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb5500d8e50 con 0x55fbbf97af40 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.171+0000 7fb545ffb640 1 -- 172.21.15.43:0/3154537192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55009bc90 con 0x55fbbf97af40 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- 172.21.15.43:0/3154537192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 msgr2=0x55fbbf9852c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb55ffff640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 0x7fb5480a6420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb558009760 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb5500cdcc0 tx=0x7fb5500d8650 comp rx=0 tx=0).stop 2024-04-25T20:50:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- 172.21.15.43:0/3154537192 shutdown_connections 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf987bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf9852c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 --2- 172.21.15.43:0/3154537192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf97aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- 172.21.15.43:0/3154537192 >> 172.21.15.43:0/3154537192 conn(0x55fbbf976b30 msgr2=0x55fbbf976f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- 172.21.15.43:0/3154537192 shutdown_connections 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- 172.21.15.43:0/3154537192 wait complete. 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 -- start start 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.172+0000 7fb568c1a740 1 Processor -- start 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf9850f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97af40 0x55fbbf9823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.182 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf988430 con 0x55fbbf985800 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf87a0b0 con 0x55fbbf97af40 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf9885b0 con 0x55fbbf97a620 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb568c1a740 10 client.0 _ll_register_callbacks cb 0x55fbbf867d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39412/0 (socket says 172.21.15.43:39412) 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 -- 172.21.15.43:0/2727543736 learned_addr learned my addr 172.21.15.43:0/2727543736 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55effd640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97af40 0x55fbbf9823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf9850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 -- 172.21.15.43:0/2727543736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 msgr2=0x55fbbf9850f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf9850f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 -- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97af40 msgr2=0x55fbbf9823e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.183 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97af40 0x55fbbf9823e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.173+0000 7fb55ffff640 1 -- 172.21.15.43:0/2727543736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbf6be620 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb55ffff640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb558009730 tx=0x7fb558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59d9a1f8571b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55802a060 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb558010e40 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5500d8e50 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb55801db90 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb568c1a740 10 client.15411 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbbf9943f0 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb55801dd30 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.174+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb558019040 con 0x55fbbf985800 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 10 client.15411 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:40.184 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 20 client.15411 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf997ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 4 client.15411 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb5500d8e50 con 0x55fbbf9958b0 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf997ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb53effd640 10 client.15411 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.175+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf997ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be6dcc8f3b76dd8 server_cookie=46fca901cf85ee58 in_seq=0 out_seq=0 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb53effd640 1 -- 172.21.15.43:0/2727543736 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fb5500d8e50 con 0x55fbbf9958b0 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb53effd640 10 client.15411 handle_command_reply: tid=0 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 client.15411 shutdown 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 msgr2=0x55fbbf982920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb558009730 tx=0x7fb558004a40 comp rx=0 tx=0).stop 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 shutdown_connections 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf997ca0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb53effd640 0 client.15411 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf985800 0x55fbbf982920 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97af40 0x55fbbf9823e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2727543736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf9850f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.176+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 >> 172.21.15.43:0/2727543736 conn(0x55fbbf976b30 msgr2=0x55fbbf97c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.177+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 shutdown_connections 2024-04-25T20:50:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.177+0000 7fb568c1a740 1 -- 172.21.15.43:0/2727543736 wait complete. 2024-04-25T20:50:40.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.177+0000 7fb568c1a740 20 client.15411 trim_cache size 0 max 16384 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 Processor -- start 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 -- start start 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 0x55fbbf991340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 0x55fbbf99d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c012ba0 con 0x55fbbf97af40 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0146e0 con 0x55fbbf97a620 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb568c1a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c013270 con 0x55fbbf985800 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39416/0 (socket says 172.21.15.43:39416) 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 -- 172.21.15.43:0/1183876158 learned_addr learned my addr 172.21.15.43:0/1183876158 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 0x55fbbf991340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55ffff640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 0x55fbbf99d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 -- 172.21.15.43:0/1183876158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 msgr2=0x55fbbf99d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 0x55fbbf99d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 -- 172.21.15.43:0/1183876158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 msgr2=0x55fbbf991340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 0x55fbbf991340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55effd640 1 -- 172.21.15.43:0/1183876158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbf998010 con 0x55fbbf97af40 2024-04-25T20:50:40.200 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55ffff640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 0x55fbbf99d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.192+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 0x55fbbf991340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb55effd640 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb554033000 tx=0x7fb554005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e354ce179bfd549d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb5457fa640 1 -- 172.21.15.43:0/1183876158 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554035040 con 0x55fbbf97af40 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb5457fa640 1 -- 172.21.15.43:0/1183876158 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb554003e40 con 0x55fbbf97af40 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb5457fa640 1 -- 172.21.15.43:0/1183876158 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55403c6a0 con 0x55fbbf97af40 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb568c1a740 1 -- 172.21.15.43:0/1183876158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 msgr2=0x55fbbf975ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.193+0000 7fb568c1a740 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb554033000 tx=0x7fb554005c00 comp rx=0 tx=0).stop 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 -- 172.21.15.43:0/1183876158 shutdown_connections 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf985800 0x55fbbf99d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf975ef0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 --2- 172.21.15.43:0/1183876158 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf97a620 0x55fbbf991340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 -- 172.21.15.43:0/1183876158 >> 172.21.15.43:0/1183876158 conn(0x55fbbf976b30 msgr2=0x55fbbf982500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 -- 172.21.15.43:0/1183876158 shutdown_connections 2024-04-25T20:50:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 -- 172.21.15.43:0/1183876158 wait complete. 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 -- start start 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.194+0000 7fb568c1a740 1 Processor -- start 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf98dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf98b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c014010 con 0x55fbbf97af40 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c013940 con 0x55fbbf985800 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c010b80 con 0x55fbbf97a620 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb568c1a740 10 client.0 _ll_register_callbacks cb 0x7fb5580105a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf98b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39422/0 (socket says 172.21.15.43:39422) 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 -- 172.21.15.43:0/2252716235 learned_addr learned my addr 172.21.15.43:0/2252716235 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 -- 172.21.15.43:0/2252716235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 msgr2=0x55fbbf98dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf98dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 -- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 msgr2=0x55fbbf98b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf98b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55effd640 1 -- 172.21.15.43:0/2252716235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbf9fadd0 con 0x55fbbf97af40 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.195+0000 7fb55ffff640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf98b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb55effd640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5540057c0 tx=0x7fb554031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dca96a2a7a608dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb53effd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554035040 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb554003c40 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb554003e40 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb554031510 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb568c1a740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fbbf9fbfa0 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.196+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb554003e40 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb554004aa0 con 0x55fbbf97af40 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 20 client.15417 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf9fe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 4 client.15417 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:50:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbbf8ed390 con 0x55fbbf9958b0 2024-04-25T20:50:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf9fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb53effd640 10 client.15417 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.197+0000 7fb55f7fe640 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf9fe700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4b1f9be2e4227a4 server_cookie=84dd79cbbd5aab27 in_seq=0 out_seq=0 2024-04-25T20:50:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.201+0000 7fb53effd640 1 -- 172.21.15.43:0/2252716235 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fbbf8ed390 con 0x55fbbf9958b0 2024-04-25T20:50:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.201+0000 7fb53effd640 10 client.15417 handle_command_reply: tid=0 2024-04-25T20:50:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.201+0000 7fb568c1a740 1 client.15417 shutdown 2024-04-25T20:50:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 msgr2=0x55fbbf98b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb5540057c0 tx=0x7fb554031a90 comp rx=0 tx=0).stop 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 shutdown_connections 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55fbbf9958b0 0x55fbbf9fe700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb53effd640 0 client.15417 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbbf985800 0x55fbbf98b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fbbf97af40 0x55fbbf98b170 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 --2- 172.21.15.43:0/2252716235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fbbf97a620 0x55fbbf98dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 >> 172.21.15.43:0/2252716235 conn(0x55fbbf976b30 msgr2=0x55fbbf990330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 shutdown_connections 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 1 -- 172.21.15.43:0/2252716235 wait complete. 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.202+0000 7fb568c1a740 20 client.15417 trim_cache size 0 max 16384 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:50:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 msgr2=0x7fb5480a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 0x7fb5480a6420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb558009760 comp rx=0 tx=0).stop 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 msgr2=0x7fb56019e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb55000d950 tx=0x7fb55000de10 comp rx=0 tx=0).stop 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 shutdown_connections 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb5480a3f60 0x7fb5480a6420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb56010c520 0x7fb5601985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb560103b00 0x7fb56019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 --2- 172.21.15.43:0/3641426612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5601031e0 0x7fb56019e3f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 >> 172.21.15.43:0/3641426612 conn(0x7fb560077fd0 msgr2=0x7fb5600fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.203+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 shutdown_connections 2024-04-25T20:50:40.209 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:39 smithi043 ceph-mon[29167]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:50:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:40.204+0000 7fb565f07640 1 -- 172.21.15.43:0/3641426612 wait complete. 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 -- 172.21.15.43:0/751789296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2406b4f0 msgr2=0x7fcf2406b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/751789296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2406b4f0 0x7fcf2406b970 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009990 tx=0x7fcf18009ca0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 -- 172.21.15.43:0/751789296 shutdown_connections 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/751789296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2410f200 0x7fcf24111630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/751789296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf24103920 0x7fcf2406afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/751789296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2406b4f0 0x7fcf2406b970 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 -- 172.21.15.43:0/751789296 >> 172.21.15.43:0/751789296 conn(0x7fcf24078780 msgr2=0x7fcf24078b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 -- 172.21.15.43:0/751789296 shutdown_connections 2024-04-25T20:50:40.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.331+0000 7fcf28ba2700 1 -- 172.21.15.43:0/751789296 wait complete. 2024-04-25T20:50:40.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.332+0000 7fcf28ba2700 1 Processor -- start 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.332+0000 7fcf28ba2700 1 -- start start 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.332+0000 7fcf28ba2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 0x7fcf2419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf28ba2700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf2410f200 0x7fcf2419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf28ba2700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39446/0 (socket says 172.21.15.43:39446) 2024-04-25T20:50:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf23fff700 1 -- 172.21.15.43:0/2749691939 learned_addr learned my addr 172.21.15.43:0/2749691939 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24114e70 con 0x7fcf2419fb70 2024-04-25T20:50:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24114cf0 con 0x7fcf2410f200 2024-04-25T20:50:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24114ff0 con 0x7fcf2406b4f0 2024-04-25T20:50:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 0x7fcf2419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf2410f200 0x7fcf2419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 -- 172.21.15.43:0/2749691939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf2410f200 msgr2=0x7fcf2419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf2410f200 0x7fcf2419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 -- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 msgr2=0x7fcf2419fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf237fe700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf241a0690 con 0x7fcf2406b4f0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.333+0000 7fcf23fff700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf237fe700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 0x7fcf2419b2a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400e9f0 tx=0x7fcf1400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf20ff9700 1 -- 172.21.15.43:0/2749691939 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400c9c0 con 0x7fcf2406b4f0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf241a0980 con 0x7fcf2406b4f0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf241a81b0 con 0x7fcf2406b4f0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf20ff9700 1 -- 172.21.15.43:0/2749691939 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf1400cb60 con 0x7fcf2406b4f0 2024-04-25T20:50:40.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.334+0000 7fcf20ff9700 1 -- 172.21.15.43:0/2749691939 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14018680 con 0x7fcf2406b4f0 2024-04-25T20:50:40.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.337+0000 7fcf20ff9700 1 -- 172.21.15.43:0/2749691939 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fcf14018820 con 0x7fcf2406b4f0 2024-04-25T20:50:40.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.338+0000 7fcf20ff9700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 0x7fcf0c0a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.338+0000 7fcf20ff9700 1 -- 172.21.15.43:0/2749691939 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcf140d0bb0 con 0x7fcf2406b4f0 2024-04-25T20:50:40.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.338+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 0x7fcf0c0a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.339+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 0x7fcf0c0a6410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b2e0 tx=0x7fcf18005960 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.339+0000 7fcf3468db80 1 Processor -- start 2024-04-25T20:50:40.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.339+0000 7fcf3468db80 1 -- start start 2024-04-25T20:50:40.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:39 smithi195 ceph-mon[33250]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:50:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b72a0 0x5569570b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55695700ac40 con 0x5569570b72a0 2024-04-25T20:50:40.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556956fb18e0 con 0x5569570c2a70 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf3468db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556957006c00 con 0x5569570b7bc0 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:51798/0 (socket says 172.21.15.43:51798) 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 -- 172.21.15.43:0/3048563432 learned_addr learned my addr 172.21.15.43:0/3048563432 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf23fff700 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b72a0 0x5569570b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 -- 172.21.15.43:0/3048563432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 msgr2=0x5569570c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 -- 172.21.15.43:0/3048563432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b72a0 msgr2=0x5569570b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b72a0 0x5569570b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.340+0000 7fcf22ffd700 1 -- 172.21.15.43:0/3048563432 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556956f756f0 con 0x5569570b7bc0 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.341+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009990 tx=0x7fcf1801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f73b37eac4dfcc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.341+0000 7fcf09ffb700 1 -- 172.21.15.43:0/3048563432 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800be50 con 0x5569570b7bc0 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.341+0000 7fcf09ffb700 1 -- 172.21.15.43:0/3048563432 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf18030950 con 0x5569570b7bc0 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.341+0000 7fcf09ffb700 1 -- 172.21.15.43:0/3048563432 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800fa60 con 0x5569570b7bc0 2024-04-25T20:50:40.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 -- 172.21.15.43:0/3048563432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 msgr2=0x5569570c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009990 tx=0x7fcf1801f000 comp rx=0 tx=0).stop 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 -- 172.21.15.43:0/3048563432 shutdown_connections 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b72a0 0x5569570b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3048563432 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b7bc0 0x5569570c2530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 -- 172.21.15.43:0/3048563432 >> 172.21.15.43:0/3048563432 conn(0x556956fe4840 msgr2=0x5569570b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 -- 172.21.15.43:0/3048563432 shutdown_connections 2024-04-25T20:50:40.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.342+0000 7fcf3468db80 1 -- 172.21.15.43:0/3048563432 wait complete. 2024-04-25T20:50:40.348 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:39 smithi112 ceph-mon[32322]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:50:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.343+0000 7fcf3468db80 1 -- start start 2024-04-25T20:50:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.343+0000 7fcf3468db80 1 Processor -- start 2024-04-25T20:50:40.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570b7bc0 0x5569570bf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39468/0 (socket says 172.21.15.43:39468) 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf23fff700 1 -- 172.21.15.43:0/4250125719 learned_addr learned my addr 172.21.15.43:0/4250125719 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569570c5530 con 0x5569570c2a70 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556956fc4560 con 0x5569570b7bc0 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5569570c56b0 con 0x5569570b72a0 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570b7bc0 0x5569570bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 -- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570b7bc0 msgr2=0x5569570bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570b7bc0 0x5569570bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 -- 172.21.15.43:0/4250125719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 msgr2=0x5569570bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf237fe700 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556956f58880 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.344+0000 7fcf23fff700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 10 client.0 _ll_register_callbacks cb 0x556956fa38d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf237fe700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570c2120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ce120 tx=0x7fcf1409cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82cf62c26f7e23cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf18030950 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf02ffd700 10 client.25075 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf02ffd700 1 -- 172.21.15.43:0/4250125719 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf140872b0 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf02ffd700 1 -- 172.21.15.43:0/4250125719 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcf140a50b0 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf02ffd700 1 -- 172.21.15.43:0/4250125719 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf140a52d0 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 10 client.25075 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5569570c5af0 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf02ffd700 1 -- 172.21.15.43:0/4250125719 <== mon.1 v2:172.21.15.195:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fcf140ce430 con 0x5569570b72a0 2024-04-25T20:50:40.356 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 10 client.25075 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 10 client.25075 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.345+0000 7fcf3468db80 20 client.25075 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x5569570c8160 0x5569570c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf3468db80 4 client.25075 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556957018430 con 0x5569570c8160 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x5569570c8160 0x5569570c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf02ffd700 10 client.25075 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.346+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x5569570c8160 0x5569570c95d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c819c9db09d95a server_cookie=6510343a816ab852 in_seq=0 out_seq=0 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf02ffd700 1 -- 172.21.15.43:0/4250125719 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556957018430 con 0x5569570c8160 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf02ffd700 10 client.25075 handle_command_reply: tid=0 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 client.25075 shutdown 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 msgr2=0x5569570c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570c2120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf140ce120 tx=0x7fcf1409cfd0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 shutdown_connections 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x5569570c8160 0x5569570c95d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf02ffd700 0 client.25075 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570c2120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c2a70 0x5569570bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 --2- 172.21.15.43:0/4250125719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570b7bc0 0x5569570bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 >> 172.21.15.43:0/4250125719 conn(0x556956fe4840 msgr2=0x5569570b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 shutdown_connections 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.347+0000 7fcf3468db80 1 -- 172.21.15.43:0/4250125719 wait complete. 2024-04-25T20:50:40.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.348+0000 7fcf3468db80 20 client.25075 trim_cache size 0 max 16384 2024-04-25T20:50:40.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 Processor -- start 2024-04-25T20:50:40.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 -- start start 2024-04-25T20:50:40.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569570c7910 con 0x5569570b7bc0 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5569570c7fe0 con 0x5569570c2a70 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.388+0000 7fcf3468db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5569570c86b0 con 0x5569570b72a0 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39474/0 (socket says 172.21.15.43:39474) 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 -- 172.21.15.43:0/16269957 learned_addr learned my addr 172.21.15.43:0/16269957 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf237fe700 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 -- 172.21.15.43:0/16269957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 msgr2=0x5569570b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 -- 172.21.15.43:0/16269957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 msgr2=0x5569570ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 -- 172.21.15.43:0/16269957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569570b43c0 con 0x5569570b7bc0 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.389+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009ce0 tx=0x7fcf18005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66824c69cec5c463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.390+0000 7fcf097fa700 1 -- 172.21.15.43:0/16269957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18040070 con 0x5569570b7bc0 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.390+0000 7fcf097fa700 1 -- 172.21.15.43:0/16269957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf18030b00 con 0x5569570b7bc0 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.390+0000 7fcf097fa700 1 -- 172.21.15.43:0/16269957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18003680 con 0x5569570b7bc0 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- 172.21.15.43:0/16269957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 msgr2=0x5569570ee370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009ce0 tx=0x7fcf18005fd0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- 172.21.15.43:0/16269957 shutdown_connections 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 --2- 172.21.15.43:0/16269957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570b7bc0 0x5569570ee370 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- 172.21.15.43:0/16269957 >> 172.21.15.43:0/16269957 conn(0x556956fe4840 msgr2=0x5569570baac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- 172.21.15.43:0/16269957 shutdown_connections 2024-04-25T20:50:40.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- 172.21.15.43:0/16269957 wait complete. 2024-04-25T20:50:40.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.391+0000 7fcf3468db80 1 -- start start 2024-04-25T20:50:40.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 Processor -- start 2024-04-25T20:50:40.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 0x5569570bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569570c9450 con 0x5569570c8160 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5569570c8d80 con 0x5569570c2a70 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5569570c9b20 con 0x5569570b72a0 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf3468db80 10 client.0 _ll_register_callbacks cb 0x556956fa38d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:51810/0 (socket says 172.21.15.43:51810) 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 -- 172.21.15.43:0/3366078414 learned_addr learned my addr 172.21.15.43:0/3366078414 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf23fff700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 0x5569570bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 -- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 msgr2=0x5569570bc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570bc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 -- 172.21.15.43:0/3366078414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 msgr2=0x5569570bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.392+0000 7fcf237fe700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 0x5569570bcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf237fe700 1 -- 172.21.15.43:0/3366078414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569570cec40 con 0x5569570b72a0 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570bc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf23fff700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 0x5569570bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf237fe700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009800 tx=0x7fcf14087040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82bd788bbf768c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14080060 con 0x5569570b72a0 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcf1409bf20 con 0x5569570b72a0 2024-04-25T20:50:40.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf18030b00 con 0x5569570b72a0 2024-04-25T20:50:40.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf140872c0 con 0x5569570b72a0 2024-04-25T20:50:40.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf3468db80 10 client.25081 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:40.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55695714aec0 con 0x5569570b72a0 2024-04-25T20:50:40.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.393+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf18030950 con 0x5569570b72a0 2024-04-25T20:50:40.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.394+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fcf1409b890 con 0x5569570b72a0 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.394+0000 7fcf3468db80 10 client.25081 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.394+0000 7fcf3468db80 10 client.25081 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf3468db80 20 client.25081 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55695714f910 0x55695714e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf3468db80 4 client.25081 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 --> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] -- command(tid 0: {"prefix": "status"}) -- 0x7fcf18030b00 con 0x55695714f910 2024-04-25T20:50:40.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55695714f910 0x55695714e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf22ffd700 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55695714f910 0x55695714e620 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba150c440f5f23b8 server_cookie=51cd708445f7ae4f in_seq=0 out_seq=0 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.395+0000 7fcf02ffd700 10 client.25081 ms_handle_connect on v2:172.21.15.112:6836/246583870 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf02ffd700 1 -- 172.21.15.43:0/3366078414 <== mds.1 v2:172.21.15.112:6836/246583870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7fcf18030b00 con 0x55695714f910 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf02ffd700 10 client.25081 handle_command_reply: tid=0 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 client.25081 shutdown 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 msgr2=0x5569570bc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009800 tx=0x7fcf14087040 comp rx=0 tx=0).stop 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 shutdown_connections 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:6836/246583870,v1:172.21.15.112:6837/246583870] conn(0x55695714f910 0x55695714e620 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569570b72a0 0x5569570bc070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569570c8160 0x5569570bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf02ffd700 0 client.25081 ms_handle_reset on v2:172.21.15.112:6836/246583870 2024-04-25T20:50:40.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 --2- 172.21.15.43:0/3366078414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569570c2a70 0x5569570bc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 >> 172.21.15.43:0/3366078414 conn(0x556956fe4840 msgr2=0x5569570becd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 shutdown_connections 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 1 -- 172.21.15.43:0/3366078414 wait complete. 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.396+0000 7fcf3468db80 20 client.25081 trim_cache size 0 max 16384 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 1, 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24449, 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:50:40.402 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 237.93457990900001, 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 28, 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 92, 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 281.85385962700002 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 msgr2=0x7fcf0c0a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 0x7fcf0c0a6410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b2e0 tx=0x7fcf18005960 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 msgr2=0x7fcf2419b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 0x7fcf2419b2a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400e9f0 tx=0x7fcf1400ed00 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 shutdown_connections 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcf0c0a3f50 0x7fcf0c0a6410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf2406b4f0 0x7fcf2419b2a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf2419fb70 0x7fcf2419fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 --2- 172.21.15.43:0/2749691939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf2410f200 0x7fcf2419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.397+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 >> 172.21.15.43:0/2749691939 conn(0x7fcf24078780 msgr2=0x7fcf24100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.398+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 shutdown_connections 2024-04-25T20:50:40.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:40.398+0000 7fcf28ba2700 1 -- 172.21.15.43:0/2749691939 wait complete. 2024-04-25T20:50:41.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-25T20:50:41.553 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:50:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:41 smithi043 ceph-mon[29167]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:50:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:41 smithi195 ceph-mon[33250]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:50:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:41 smithi112 ceph-mon[32322]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 -- 172.21.15.43:0/762037843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0102300 msgr2=0x7fa8e010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/762037843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0102300 0x7fa8e010e7f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800b0a0 tx=0x7fa8d800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 -- 172.21.15.43:0/762037843 shutdown_connections 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/762037843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0107990 0x7fa8e0107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/762037843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0102300 0x7fa8e010e7f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/762037843 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0101940 0x7fa8e0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 -- 172.21.15.43:0/762037843 >> 172.21.15.43:0/762037843 conn(0x7fa8e00788f0 msgr2=0x7fa8e0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 -- 172.21.15.43:0/762037843 shutdown_connections 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.370+0000 7fa8e6c28700 1 -- 172.21.15.43:0/762037843 wait complete. 2024-04-25T20:50:43.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 Processor -- start 2024-04-25T20:50:43.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 -- start start 2024-04-25T20:50:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0102300 0x7fa8e0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 0x7fa8e019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0111c70 con 0x7fa8e0101940 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0111af0 con 0x7fa8e0107990 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.371+0000 7fa8e6c28700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0111df0 con 0x7fa8e0102300 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39508/0 (socket says 172.21.15.43:39508) 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 -- 172.21.15.43:0/1655195791 learned_addr learned my addr 172.21.15.43:0/1655195791 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8dffff700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0102300 0x7fa8e0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 0x7fa8e019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 -- 172.21.15.43:0/1655195791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0102300 msgr2=0x7fa8e0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0102300 0x7fa8e0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 -- 172.21.15.43:0/1655195791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 msgr2=0x7fa8e019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 0x7fa8e019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 -- 172.21.15.43:0/1655195791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e019e1a0 con 0x7fa8e0101940 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 0x7fa8e019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.372+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400d980 tx=0x7fa8d400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.373+0000 7fa8ddffb700 1 -- 172.21.15.43:0/1655195791 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4017070 con 0x7fa8e0101940 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.373+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e019e490 con 0x7fa8e0101940 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.373+0000 7fa8ddffb700 1 -- 172.21.15.43:0/1655195791 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8d4004d00 con 0x7fa8e0101940 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.373+0000 7fa8ddffb700 1 -- 172.21.15.43:0/1655195791 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40054e0 con 0x7fa8e0101940 2024-04-25T20:50:43.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.373+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e01a5d10 con 0x7fa8e0101940 2024-04-25T20:50:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.375+0000 7fa8ddffb700 1 -- 172.21.15.43:0/1655195791 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fa8d4004750 con 0x7fa8e0101940 2024-04-25T20:50:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.376+0000 7fa8ddffb700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 0x7fa8d00a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.376+0000 7fa8ddffb700 1 -- 172.21.15.43:0/1655195791 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa8d40d09b0 con 0x7fa8e0101940 2024-04-25T20:50:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.376+0000 7fa8dffff700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 0x7fa8d00a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.377+0000 7fa8dffff700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 0x7fa8d00a6390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005950 tx=0x7fa8cc0058e0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 Processor -- start 2024-04-25T20:50:43.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 -- start start 2024-04-25T20:50:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e3b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39510/0 (socket says 172.21.15.43:39510) 2024-04-25T20:50:43.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e3b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e3b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:51844/0 (socket says 172.21.15.43:51844) 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e48c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8dffff700 1 -- 172.21.15.43:0/3633730147 learned_addr learned my addr 172.21.15.43:0/3633730147 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb9d8ec40 con 0x557bb9e3b9d0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557bb9d358e0 con 0x557bb9e46880 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.378+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557bb9d8ac00 con 0x557bb9e3b0b0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 -- 172.21.15.43:0/3633730147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 msgr2=0x557bb9e3b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e3b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 -- 172.21.15.43:0/3633730147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 msgr2=0x557bb9e48c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e48c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 -- 172.21.15.43:0/3633730147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb9cf96f0 con 0x557bb9e3b9d0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8dffff700 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00fd40 tx=0x7fa8cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbe25ad52421e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.379+0000 7fa8caffd700 1 -- 172.21.15.43:0/3633730147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc022070 con 0x557bb9e3b9d0 2024-04-25T20:50:43.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.380+0000 7fa8caffd700 1 -- 172.21.15.43:0/3633730147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8cc011bb0 con 0x557bb9e3b9d0 2024-04-25T20:50:43.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.380+0000 7fa8caffd700 1 -- 172.21.15.43:0/3633730147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc01d6a0 con 0x557bb9e3b9d0 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.380+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 msgr2=0x557bb9e46340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.380+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00fd40 tx=0x7fa8cc012000 comp rx=0 tx=0).stop 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 shutdown_connections 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e3b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e48c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/3633730147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e46340 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 >> 172.21.15.43:0/3633730147 conn(0x557bb9d68840 msgr2=0x557bb9e37580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 shutdown_connections 2024-04-25T20:50:43.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.381+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/3633730147 wait complete. 2024-04-25T20:50:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.382+0000 7fa8f14b1b80 1 -- start start 2024-04-25T20:50:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.382+0000 7fa8f14b1b80 1 Processor -- start 2024-04-25T20:50:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 0x557bb9e437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4d780 con 0x557bb9e3b9d0 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557bb9d48560 con 0x557bb9e3b0b0 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4d900 con 0x557bb9e46880 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:56280/0 (socket says 172.21.15.43:56280) 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 -- 172.21.15.43:0/2490352216 learned_addr learned my addr 172.21.15.43:0/2490352216 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8f14b1b80 10 client.0 _ll_register_callbacks cb 0x557bb9d278d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:43.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8dffff700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 0x557bb9e437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 -- 172.21.15.43:0/2490352216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 msgr2=0x557bb9e437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 0x557bb9e437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 -- 172.21.15.43:0/2490352216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 msgr2=0x557bb9e432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e49c4700 1 -- 172.21.15.43:0/2490352216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb9cdc880 con 0x557bb9e3b0b0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.383+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 0x557bb9e437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4099100 tx=0x7fa8d409c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8cf3b511744f6e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8bffff700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40a0ae0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa8d409aa30 con 0x557bb9e3b0b0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8cc011bb0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8d40a53a0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8f14b1b80 10 client.25145 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557bb9e49320 con 0x557bb9e3b0b0 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.384+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8cc011bb0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa8d40a4f10 con 0x557bb9e3b0b0 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 10 client.25145 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 10 client.25145 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 20 client.25145 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9e4b910 0x557bb9e4cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 4 client.25145 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bb9d9c430 con 0x557bb9e4b910 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8dffff700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9e4b910 0x557bb9e4cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8bffff700 10 client.25145 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:43.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.385+0000 7fa8dffff700 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9e4b910 0x557bb9e4cd80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e067abebeaffb22 server_cookie=44f117dfcce9926b in_seq=0 out_seq=0 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8bffff700 1 -- 172.21.15.43:0/2490352216 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557bb9d9c430 con 0x557bb9e4b910 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8bffff700 10 client.25145 handle_command_reply: tid=0 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8f14b1b80 1 client.25145 shutdown 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 msgr2=0x557bb9e45fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4099100 tx=0x7fa8d409c370 comp rx=0 tx=0).stop 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 shutdown_connections 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.386+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9e4b910 0x557bb9e4cd80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8bffff700 0 client.25145 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e46880 0x557bb9e437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b0b0 0x557bb9e45fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/2490352216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b9d0 0x557bb9e432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 >> 172.21.15.43:0/2490352216 conn(0x557bb9d68840 msgr2=0x557bb9e371b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 shutdown_connections 2024-04-25T20:50:43.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/2490352216 wait complete. 2024-04-25T20:50:43.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.387+0000 7fa8f14b1b80 20 client.25145 trim_cache size 0 max 16384 2024-04-25T20:50:43.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 Processor -- start 2024-04-25T20:50:43.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 -- start start 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b9d0 0x557bb9e42100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e60960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4b0c0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4b790 con 0x557bb9e46880 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.408+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4be60 con 0x557bb9e3b9d0 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39530/0 (socket says 172.21.15.43:39530) 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 -- 172.21.15.43:0/82859239 learned_addr learned my addr 172.21.15.43:0/82859239 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e60960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 -- 172.21.15.43:0/82859239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b9d0 msgr2=0x557bb9e42100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b9d0 0x557bb9e42100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 -- 172.21.15.43:0/82859239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 msgr2=0x557bb9e60960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e60960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.409+0000 7fa8e49c4700 1 -- 172.21.15.43:0/82859239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bb9e3cb00 con 0x557bb9e3b0b0 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.410+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400d950 tx=0x7fa8d409c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f3739d968a5367 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.410+0000 7fa8ca7fc700 1 -- 172.21.15.43:0/82859239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40a0ae0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.410+0000 7fa8ca7fc700 1 -- 172.21.15.43:0/82859239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8d40ce290 con 0x557bb9e3b0b0 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.410+0000 7fa8ca7fc700 1 -- 172.21.15.43:0/82859239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4004a40 con 0x557bb9e3b0b0 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/82859239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 msgr2=0x557bb9e41bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400d950 tx=0x7fa8d409c8b0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/82859239 shutdown_connections 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e46880 0x557bb9e60960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e3b0b0 0x557bb9e41bc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/82859239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b9d0 0x557bb9e42100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/82859239 >> 172.21.15.43:0/82859239 conn(0x557bb9d68840 msgr2=0x557bb9e43270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/82859239 shutdown_connections 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/82859239 wait complete. 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.411+0000 7fa8f14b1b80 1 -- start start 2024-04-25T20:50:43.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 Processor -- start 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e40700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 0x557bb9e40c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4cc00 con 0x557bb9e46880 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4c530 con 0x557bb9e3b9d0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557bb9e4d2d0 con 0x557bb9e3b0b0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8f14b1b80 10 client.0 _ll_register_callbacks cb 0x557bb9d278d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8e51c5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8e51c5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39542/0 (socket says 172.21.15.43:39542) 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8e51c5700 1 -- 172.21.15.43:0/961639597 learned_addr learned my addr 172.21.15.43:0/961639597 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.412+0000 7fa8dffff700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 0x557bb9e40c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e40700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 -- 172.21.15.43:0/961639597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 msgr2=0x557bb9e40700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e40700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 -- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 msgr2=0x557bb9e40c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 0x557bb9e40c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 -- 172.21.15.43:0/961639597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bb9e58460 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8dffff700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 0x557bb9e40c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8e51c5700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009fd0 tx=0x7fa8d8009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8982501d724f7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8bffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8004e60 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.413+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa8d80074e0 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d40ce290 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8d802c050 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8f14b1b80 10 client.15450 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557bb9ebd8e0 con 0x557bb9e46880 2024-04-25T20:50:43.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8d40ce290 con 0x557bb9e46880 2024-04-25T20:50:43.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.414+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa8d8011070 con 0x557bb9e46880 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 10 client.15450 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 20 client.15450 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9ec2510 0x557bb9ec1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 4 client.15450 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "status"}) -- 0x557bb9d964d0 con 0x557bb9ec2510 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.415+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9ec2510 0x557bb9ec1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8e49c4700 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9ec2510 0x557bb9ec1220 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7755a7ff53f688e server_cookie=82b2ffd3e0a97f3e in_seq=0 out_seq=0 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8bffff700 10 client.15450 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8bffff700 1 -- 172.21.15.43:0/961639597 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557bb9d964d0 con 0x557bb9ec2510 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8bffff700 10 client.15450 handle_command_reply: tid=0 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 client.15450 shutdown 2024-04-25T20:50:43.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 msgr2=0x557bb9e5d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009fd0 tx=0x7fa8d8009370 comp rx=0 tx=0).stop 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 shutdown_connections 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557bb9ec2510 0x557bb9ec1220 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557bb9e3b0b0 0x557bb9e40700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557bb9e46880 0x557bb9e5d050 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 --2- 172.21.15.43:0/961639597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557bb9e3b9d0 0x557bb9e40c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 >> 172.21.15.43:0/961639597 conn(0x557bb9d68840 msgr2=0x557bb9e37060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.416+0000 7fa8bffff700 0 client.15450 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.417+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 shutdown_connections 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.417+0000 7fa8f14b1b80 1 -- 172.21.15.43:0/961639597 wait complete. 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.417+0000 7fa8f14b1b80 20 client.15450 trim_cache size 0 max 16384 2024-04-25T20:50:43.421 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "92e6f50e-0343-11ef-bc93-c7b262605968", 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 24470, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 254.93006759299999, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 28, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 92, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 91, 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 271.06818093499999 2024-04-25T20:50:43.422 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 msgr2=0x7fa8d00a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 0x7fa8d00a6390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005950 tx=0x7fa8cc0058e0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 msgr2=0x7fa8e01991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400d980 tx=0x7fa8d400dd40 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 shutdown_connections 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa8d00a3ed0 0x7fa8d00a6390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e0107990 0x7fa8e019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8e0101940 0x7fa8e01991e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 --2- 172.21.15.43:0/1655195791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8e0102300 0x7fa8e0199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 >> 172.21.15.43:0/1655195791 conn(0x7fa8e00788f0 msgr2=0x7fa8e00ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 shutdown_connections 2024-04-25T20:50:43.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:50:43.418+0000 7fa8e6c28700 1 -- 172.21.15.43:0/1655195791 wait complete. 2024-04-25T20:50:44.086 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:43 smithi043 ceph-mon[29167]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-25T20:50:44.267 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-25T20:50:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:43 smithi195 ceph-mon[33250]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-25T20:50:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:43 smithi112 ceph-mon[32322]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-25T20:50:46.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:45 smithi043 ceph-mon[29167]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:45 smithi195 ceph-mon[33250]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:45 smithi112 ceph-mon[32322]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:48.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:47 smithi043 ceph-mon[29167]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:47 smithi195 ceph-mon[33250]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:48.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:47 smithi112 ceph-mon[32322]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:50.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:49 smithi043 ceph-mon[29167]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:49 smithi195 ceph-mon[33250]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:49 smithi112 ceph-mon[32322]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:52.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:51 smithi043 ceph-mon[29167]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:51 smithi195 ceph-mon[33250]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:51 smithi112 ceph-mon[32322]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-25T20:50:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 -- 172.21.15.43:0/395763950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 msgr2=0x7fab3c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 --2- 172.21.15.43:0/395763950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c10dd40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab34009ca0 tx=0x7fab3402a8c0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 -- 172.21.15.43:0/395763950 shutdown_connections 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 --2- 172.21.15.43:0/395763950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c10dd40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 --2- 172.21.15.43:0/395763950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c101aa0 0x7fab3c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 --2- 172.21.15.43:0/395763950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c1010f0 0x7fab3c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 -- 172.21.15.43:0/395763950 >> 172.21.15.43:0/395763950 conn(0x7fab3c077fd0 msgr2=0x7fab3c0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.345+0000 7fab4326b640 1 -- 172.21.15.43:0/395763950 shutdown_connections 2024-04-25T20:50:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.346+0000 7fab4326b640 1 -- 172.21.15.43:0/395763950 wait complete. 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.346+0000 7fab4326b640 1 Processor -- start 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.346+0000 7fab4326b640 1 -- start start 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c1010f0 0x7fab3c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c197e00 0x7fab3c1a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c111210 con 0x7fab3c106170 2024-04-25T20:50:53.351 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c111090 con 0x7fab3c1010f0 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab4326b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c111390 con 0x7fab3c197e00 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47624/0 (socket says 172.21.15.43:47624) 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 -- 172.21.15.43:0/948582991 learned_addr learned my addr 172.21.15.43:0/948582991 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab41007640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c1010f0 0x7fab3c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab41808640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c197e00 0x7fab3c1a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 -- 172.21.15.43:0/948582991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c197e00 msgr2=0x7fab3c1a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c197e00 0x7fab3c1a6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 -- 172.21.15.43:0/948582991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c1010f0 msgr2=0x7fab3c197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c1010f0 0x7fab3c197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.347+0000 7fab40806640 1 -- 172.21.15.43:0/948582991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c1a6fc0 con 0x7fab3c106170 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.348+0000 7fab40806640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00e9d0 tx=0x7fab2c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.348+0000 7fab327fc640 1 -- 172.21.15.43:0/948582991 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00cd80 con 0x7fab3c106170 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.348+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c1a72b0 con 0x7fab3c106170 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.348+0000 7fab327fc640 1 -- 172.21.15.43:0/948582991 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab2c0035f0 con 0x7fab3c106170 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.349+0000 7fab327fc640 1 -- 172.21.15.43:0/948582991 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c010690 con 0x7fab3c106170 2024-04-25T20:50:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.349+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c1a77a0 con 0x7fab3c106170 2024-04-25T20:50:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.351+0000 7fab327fc640 1 -- 172.21.15.43:0/948582991 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fab2c0037a0 con 0x7fab3c106170 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.352+0000 7fab327fc640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 0x7fab280a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.352+0000 7fab45f7f740 1 Processor -- start 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 -- start start 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab327fc640 1 -- 172.21.15.43:0/948582991 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fab2c0d0cc0 con 0x7fab3c106170 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab41007640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 0x7fab280a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 0x557b2c60ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 0x557b2c6192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b2c573970 con 0x557b2c60ef40 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557b2c5104a0 con 0x557b2c60e620 2024-04-25T20:50:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab45f7f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557b2c56f930 con 0x557b2c619800 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab41808640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab41808640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:50318/0 (socket says 172.21.15.43:50318) 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab41808640 1 -- 172.21.15.43:0/1178966953 learned_addr learned my addr 172.21.15.43:0/1178966953 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab41007640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 0x557b2c60ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.353+0000 7fab40806640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 0x557b2c6192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 0x7fab280a6290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab38009c20 tx=0x7fab38005f90 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 -- 172.21.15.43:0/1178966953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 msgr2=0x557b2c61bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 -- 172.21.15.43:0/1178966953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 msgr2=0x557b2c6192c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 0x557b2c6192c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 -- 172.21.15.43:0/1178966953 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2c286210 con 0x557b2c60e620 2024-04-25T20:50:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41808640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab40806640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 0x557b2c6192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:53.358 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab41007640 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 0x557b2c60ea00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab38011ca0 tx=0x7fab3801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0dbecf989d8ded0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab277fe640 1 -- 172.21.15.43:0/1178966953 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38029070 con 0x557b2c60e620 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab277fe640 1 -- 172.21.15.43:0/1178966953 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab3801ce10 con 0x557b2c60e620 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.354+0000 7fab277fe640 1 -- 172.21.15.43:0/1178966953 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3800f930 con 0x557b2c60e620 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 -- 172.21.15.43:0/1178966953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 msgr2=0x557b2c60ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 0x557b2c60ea00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab38011ca0 tx=0x7fab3801c000 comp rx=0 tx=0).stop 2024-04-25T20:50:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 -- 172.21.15.43:0/1178966953 shutdown_connections 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c619800 0x557b2c61bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60ef40 0x557b2c6192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1178966953 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60e620 0x557b2c60ea00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.355+0000 7fab45f7f740 1 -- 172.21.15.43:0/1178966953 >> 172.21.15.43:0/1178966953 conn(0x557b2c60ab30 msgr2=0x557b2c60af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.356+0000 7fab45f7f740 1 -- 172.21.15.43:0/1178966953 shutdown_connections 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.356+0000 7fab45f7f740 1 -- 172.21.15.43:0/1178966953 wait complete. 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.356+0000 7fab45f7f740 1 -- start start 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.356+0000 7fab45f7f740 1 Processor -- start 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c616490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c616a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b2c61c430 con 0x557b2c60e620 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557b2c50e0b0 con 0x557b2c619800 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557b2c61c5b0 con 0x557b2c60ef40 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab45f7f740 10 client.0 _ll_register_callbacks cb 0x557b2c4fbd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41007640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c616a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab40806640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c616490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41007640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47640/0 (socket says 172.21.15.43:47640) 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41007640 1 -- 172.21.15.43:0/3341468265 learned_addr learned my addr 172.21.15.43:0/3341468265 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 -- 172.21.15.43:0/3341468265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 msgr2=0x557b2c616490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c616490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 -- 172.21.15.43:0/3341468265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 msgr2=0x557b2c6191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41808640 1 -- 172.21.15.43:0/3341468265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2c352620 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.357+0000 7fab41007640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab41808640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c616a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab34004af0 tx=0x7fab34005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202c996f1f68cb63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34003970 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fab34003b10 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab3801ce10 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab34003d10 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab45f7f740 10 client.25160 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b2c6283a0 con 0x557b2c619800 2024-04-25T20:50:53.364 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.358+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab34036050 con 0x557b2c619800 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fab34004660 con 0x557b2c619800 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 10 client.25160 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 10 client.25160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 20 client.25160 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c629810 0x557b2c62bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 4 client.25160 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.359+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fab3801ce10 con 0x557b2c629810 2024-04-25T20:50:53.365 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.360+0000 7fab41007640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c629810 0x557b2c62bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.366 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.360+0000 7fab41007640 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c629810 0x557b2c62bc00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=decabe1da5e7c3b1 server_cookie=ed9177f81c745b82 in_seq=0 out_seq=0 2024-04-25T20:50:53.366 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.360+0000 7fab24ff9640 10 client.25160 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab24ff9640 1 -- 172.21.15.43:0/3341468265 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7fab3801ce10 con 0x557b2c629810 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab24ff9640 10 client.25160 handle_command_reply: tid=0 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 client.25160 shutdown 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 msgr2=0x557b2c616a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c616a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab34004af0 tx=0x7fab34005f10 comp rx=0 tx=0).stop 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 shutdown_connections 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c629810 0x557b2c62bc00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c616a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab24ff9640 0 client.25160 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c616490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 --2- 172.21.15.43:0/3341468265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6191a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 >> 172.21.15.43:0/3341468265 conn(0x557b2c60ab30 msgr2=0x557b2c6108b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.361+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 shutdown_connections 2024-04-25T20:50:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.362+0000 7fab45f7f740 1 -- 172.21.15.43:0/3341468265 wait complete. 2024-04-25T20:50:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.362+0000 7fab45f7f740 20 client.25160 trim_cache size 0 max 16384 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 Processor -- start 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 -- start start 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6252f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c609b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c6314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1afaf0 con 0x557b2c60e620 2024-04-25T20:50:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b1630 con 0x557b2c619800 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab45f7f740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b01c0 con 0x557b2c60ef40 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab40806640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c609b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab40806640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c609b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:50330/0 (socket says 172.21.15.43:50330) 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab41007640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab40806640 1 -- 172.21.15.43:0/1911514956 learned_addr learned my addr 172.21.15.43:0/1911514956 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.392+0000 7fab41808640 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c6314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 -- 172.21.15.43:0/1911514956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 msgr2=0x557b2c609b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c609b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 -- 172.21.15.43:0/1911514956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 msgr2=0x557b2c6252f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6252f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 -- 172.21.15.43:0/1911514956 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b2c60f8d0 con 0x557b2c619800 2024-04-25T20:50:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41007640 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6252f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:50:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab41808640 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c6314f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab3402ade0 tx=0x7fab3402fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd2cba1e122f3e26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab26ffd640 1 -- 172.21.15.43:0/1911514956 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3402fc70 con 0x557b2c619800 2024-04-25T20:50:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab26ffd640 1 -- 172.21.15.43:0/1911514956 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab34051020 con 0x557b2c619800 2024-04-25T20:50:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.393+0000 7fab26ffd640 1 -- 172.21.15.43:0/1911514956 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340306f0 con 0x557b2c619800 2024-04-25T20:50:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 -- 172.21.15.43:0/1911514956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 msgr2=0x557b2c6314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c6314f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab3402ade0 tx=0x7fab3402fa50 comp rx=0 tx=0).stop 2024-04-25T20:50:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 -- 172.21.15.43:0/1911514956 shutdown_connections 2024-04-25T20:50:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c619800 0x557b2c6314f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60ef40 0x557b2c609b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 --2- 172.21.15.43:0/1911514956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c60e620 0x557b2c6252f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.394+0000 7fab45f7f740 1 -- 172.21.15.43:0/1911514956 >> 172.21.15.43:0/1911514956 conn(0x557b2c60ab30 msgr2=0x557b2c609420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.395+0000 7fab45f7f740 1 -- 172.21.15.43:0/1911514956 shutdown_connections 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.395+0000 7fab45f7f740 1 -- 172.21.15.43:0/1911514956 wait complete. 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.395+0000 7fab45f7f740 1 -- start start 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.395+0000 7fab45f7f740 1 Processor -- start 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 0x557b2c61f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60ef40 0x557b2c61fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab41007640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 0x557b2c61f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab41007640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 0x557b2c61f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:50338/0 (socket says 172.21.15.43:50338) 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab40806640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60ef40 0x557b2c61fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab41808640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab41808640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47648/0 (socket says 172.21.15.43:47648) 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab41007640 1 -- 172.21.15.43:0/2023335038 learned_addr learned my addr 172.21.15.43:0/2023335038 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b0f60 con 0x557b2c619800 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1b0890 con 0x557b2c60ef40 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.396+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1adad0 con 0x557b2c60e620 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab45f7f740 10 client.0 _ll_register_callbacks cb 0x7fab34009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 -- 172.21.15.43:0/2023335038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 msgr2=0x557b2c61f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 0x557b2c61f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 -- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60ef40 msgr2=0x557b2c61fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:50:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60ef40 0x557b2c61fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b2c620310 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab41808640 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab3402c010 tx=0x7fab3402ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1108bad46453d88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34031660 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fab34041040 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.397+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab34051020 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.398+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab34066050 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.398+0000 7fab45f7f740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.398+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b2c690350 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.398+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab34036040 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fab34030c80 con 0x557b2c619800 2024-04-25T20:50:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 20 client.15468 populate_metadata read hostname 'smithi043' 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c690950 0x557b2c692d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 4 client.15468 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.399+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fab34051020 con 0x557b2c690950 2024-04-25T20:50:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.400+0000 7fab41007640 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c690950 0x557b2c692d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:50:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.400+0000 7fab41007640 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c690950 0x557b2c692d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48b89e017e39c220 server_cookie=a6a588a3e0c7e1e3 in_seq=0 out_seq=0 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.400+0000 7fab24ff9640 10 client.15468 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab24ff9640 1 -- 172.21.15.43:0/2023335038 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fab34051020 con 0x557b2c690950 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab24ff9640 10 client.15468 handle_command_reply: tid=0 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 client.15468 shutdown 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 msgr2=0x557b2c68ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab3402c010 tx=0x7fab3402ff00 comp rx=0 tx=0).stop 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 shutdown_connections 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557b2c690950 0x557b2c692d70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b2c619800 0x557b2c68ed70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b2c60ef40 0x557b2c61fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 --2- 172.21.15.43:0/2023335038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b2c60e620 0x557b2c61f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab24ff9640 0 client.15468 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 >> 172.21.15.43:0/2023335038 conn(0x557b2c60ab30 msgr2=0x557b2c609cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 shutdown_connections 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.404+0000 7fab45f7f740 1 -- 172.21.15.43:0/2023335038 wait complete. 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab45f7f740 20 client.15468 trim_cache size 0 max 16384 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:50:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:50:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:50:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 msgr2=0x7fab280a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 0x7fab280a6290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab38009c20 tx=0x7fab38005f90 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 msgr2=0x7fab3c1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00e9d0 tx=0x7fab2c00ee90 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 shutdown_connections 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fab280a3dd0 0x7fab280a6290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c197e00 0x7fab3c1a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3c106170 0x7fab3c1978c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 --2- 172.21.15.43:0/948582991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fab3c1010f0 0x7fab3c197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.405+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 >> 172.21.15.43:0/948582991 conn(0x7fab3c077fd0 msgr2=0x7fab3c0fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.406+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 shutdown_connections 2024-04-25T20:50:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:50:53.406+0000 7fab4326b640 1 -- 172.21.15.43:0/948582991 wait complete. 2024-04-25T20:50:54.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:53 smithi043 ceph-mon[29167]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:53 smithi195 ceph-mon[33250]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:53 smithi112 ceph-mon[32322]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:50:56.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:55 smithi043 ceph-mon[29167]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-25T20:50:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:55 smithi195 ceph-mon[33250]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-25T20:50:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:55 smithi112 ceph-mon[32322]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2024-04-25T20:50:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:57 smithi043 ceph-mon[29167]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:57 smithi195 ceph-mon[33250]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:58.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:57 smithi112 ceph-mon[32322]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-25T20:50:59.268 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-25T20:50:59.268 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.2 2024-04-25T20:50:59.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:50:59.597 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:00.026 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:50:59 smithi043 ceph-mon[29167]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:51:00.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:50:59 smithi195 ceph-mon[33250]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:51:00.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:50:59 smithi112 ceph-mon[32322]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 -- 172.21.15.43:0/2914698296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06b980 msgr2=0x7f4b0c10f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/2914698296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06b980 0x7f4b0c10f8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400b0a0 tx=0x7f4b0400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 -- 172.21.15.43:0/2914698296 shutdown_connections 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/2914698296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06b980 0x7f4b0c10f8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/2914698296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c108a20 0x7f4b0c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/2914698296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.637+0000 7f4b12ba4700 1 -- 172.21.15.43:0/2914698296 >> 172.21.15.43:0/2914698296 conn(0x7f4b0c0788b0 msgr2=0x7f4b0c078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:01.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.638+0000 7f4b12ba4700 1 -- 172.21.15.43:0/2914698296 shutdown_connections 2024-04-25T20:51:01.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.638+0000 7f4b12ba4700 1 -- 172.21.15.43:0/2914698296 wait complete. 2024-04-25T20:51:01.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 Processor -- start 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 -- start start 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c108a20 0x7f4b0c102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112d40 con 0x7f4b0c06afe0 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112bc0 con 0x7f4b0c06b980 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.639+0000 7f4b12ba4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c112ec0 con 0x7f4b0c108a20 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b11141700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c108a20 0x7f4b0c102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:50800/0 (socket says 172.21.15.43:50800) 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 -- 172.21.15.43:0/1682721721 learned_addr learned my addr 172.21.15.43:0/1682721721 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:01.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b10940700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 -- 172.21.15.43:0/1682721721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c108a20 msgr2=0x7f4b0c102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c108a20 0x7f4b0c102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 -- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 msgr2=0x7f4b0c1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c1035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b0bfff700 1 -- 172.21.15.43:0/1682721721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c1abae0 con 0x7f4b0c06b980 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.640+0000 7f4b10940700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b0bfff700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c920 tx=0x7f4af800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007b00 con 0x7f4b0c06b980 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c1abd70 con 0x7f4b0c06b980 2024-04-25T20:51:01.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4af8004d00 con 0x7f4b0c06b980 2024-04-25T20:51:01.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c1ac250 con 0x7f4b0c06b980 2024-04-25T20:51:01.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.641+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8005610 con 0x7f4b0c06b980 2024-04-25T20:51:01.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.642+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c104160 con 0x7f4b0c06b980 2024-04-25T20:51:01.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.644+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f4af8045020 con 0x7f4b0c06b980 2024-04-25T20:51:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.645+0000 7f4b09ffb700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 0x7f4afc0a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:01.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.646+0000 7f4b10940700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 0x7f4afc0a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.646+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4af80d0ca0 con 0x7f4b0c06b980 2024-04-25T20:51:01.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.646+0000 7f4b10940700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 0x7f4afc0a6410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000afa0 tx=0x7f4b0000a380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:01.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.648+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4af8014030 con 0x7f4b0c06b980 2024-04-25T20:51:01.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.931+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b0c02df80 con 0x7f4b0c06b980 2024-04-25T20:51:01.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.932+0000 7f4b09ffb700 1 -- 172.21.15.43:0/1682721721 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f4af8004eb0 con 0x7f4b0c06b980 2024-04-25T20:51:01.934 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:51:01.934 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 msgr2=0x7f4afc0a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 0x7f4afc0a6410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000afa0 tx=0x7f4b0000a380 comp rx=0 tx=0).stop 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 msgr2=0x7f4b0c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c920 tx=0x7f4af800cc30 comp rx=0 tx=0).stop 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 shutdown_connections 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4afc0a3f50 0x7f4afc0a6410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b0c108a20 0x7f4b0c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0c06afe0 0x7f4b0c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 --2- 172.21.15.43:0/1682721721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4b0c06b980 0x7f4b0c101a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 >> 172.21.15.43:0/1682721721 conn(0x7f4b0c0788b0 msgr2=0x7f4b0c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 shutdown_connections 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:01.936+0000 7f4b12ba4700 1 -- 172.21.15.43:0/1682721721 wait complete. 2024-04-25T20:51:01.939 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:51:02.267 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:01 smithi043 ceph-mon[29167]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-04-25T20:51:02.267 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1682721721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:02.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:01 smithi195 ceph-mon[33250]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-04-25T20:51:02.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1682721721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:02.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:01 smithi112 ceph-mon[32322]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-04-25T20:51:02.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1682721721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:02.753 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24470 quiesce db / --timeout 60 --expiration 86.2 --await-for 42.0' 2024-04-25T20:51:02.753 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24470 quiesce db / --timeout 60 --expiration 86.2 --await-for 42.0 2024-04-25T20:51:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:03 smithi043 ceph-mon[29167]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-25T20:51:04.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:03 smithi195 ceph-mon[33250]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-25T20:51:04.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:03 smithi112 ceph-mon[32322]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-25T20:51:05.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:51:05.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:51:05.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:51:05.099 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:04 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 -- 172.21.15.43:0/2613022816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006b990 msgr2=0x7f4f5010f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 --2- 172.21.15.43:0/2613022816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006b990 0x7f4f5010f920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800b0a0 tx=0x7f4f4800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 -- 172.21.15.43:0/2613022816 shutdown_connections 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 --2- 172.21.15.43:0/2613022816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 0x7f4f50108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 --2- 172.21.15.43:0/2613022816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006b990 0x7f4f5010f920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 --2- 172.21.15.43:0/2613022816 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006aff0 0x7f4f5006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.172+0000 7f4f558b8700 1 -- 172.21.15.43:0/2613022816 >> 172.21.15.43:0/2613022816 conn(0x7f4f50078980 msgr2=0x7f4f50078d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.173+0000 7f4f558b8700 1 -- 172.21.15.43:0/2613022816 shutdown_connections 2024-04-25T20:51:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.173+0000 7f4f558b8700 1 -- 172.21.15.43:0/2613022816 wait complete. 2024-04-25T20:51:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.173+0000 7f4f558b8700 1 Processor -- start 2024-04-25T20:51:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 -- start start 2024-04-25T20:51:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 0x7f4f501996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 0x7f4f5019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50112db0 con 0x7f4f5006aff0 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50112c30 con 0x7f4f5006b990 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f558b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50112f30 con 0x7f4f50108a50 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34308/0 (socket says 172.21.15.43:34308) 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f4effd700 1 -- 172.21.15.43:0/1020042893 learned_addr learned my addr 172.21.15.43:0/1020042893 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 0x7f4f501996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.174+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 0x7f4f5019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 -- 172.21.15.43:0/1020042893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 msgr2=0x7f4f5019da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 0x7f4f5019da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 -- 172.21.15.43:0/1020042893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 msgr2=0x7f4f501996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 0x7f4f501996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 -- 172.21.15.43:0/1020042893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5019e1b0 con 0x7f4f5006aff0 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 0x7f4f501996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:51:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d980 tx=0x7f4f4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f548b6700 1 -- 172.21.15.43:0/1020042893 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40017070 con 0x7f4f5006aff0 2024-04-25T20:51:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5019e4a0 con 0x7f4f5006aff0 2024-04-25T20:51:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f548b6700 1 -- 172.21.15.43:0/1020042893 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f40005020 con 0x7f4f5006aff0 2024-04-25T20:51:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f548b6700 1 -- 172.21.15.43:0/1020042893 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40009bf0 con 0x7f4f5006aff0 2024-04-25T20:51:05.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.175+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f501a5d20 con 0x7f4f5006aff0 2024-04-25T20:51:05.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.179+0000 7f4f548b6700 1 -- 172.21.15.43:0/1020042893 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f4f40010460 con 0x7f4f5006aff0 2024-04-25T20:51:05.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.179+0000 7f4f60141b80 1 Processor -- start 2024-04-25T20:51:05.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.179+0000 7f4f548b6700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 0x7f4f380a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.179+0000 7f4f60141b80 1 -- start start 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f548b6700 1 -- 172.21.15.43:0/1020042893 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f400d08d0 con 0x7f4f5006aff0 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16ccc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563c16c11ec0 con 0x563c16cbea80 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563c16bb8af0 con 0x563c16cbf3a0 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f60141b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563c16c0de80 con 0x563c16cca270 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 0x7f4f380a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34318/0 (socket says 172.21.15.43:34318) 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 -- 172.21.15.43:0/538411960 learned_addr learned my addr 172.21.15.43:0/538411960 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16ccc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 -- 172.21.15.43:0/538411960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 msgr2=0x563c16ccc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16ccc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 -- 172.21.15.43:0/538411960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 msgr2=0x563c16cc9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.180+0000 7f4f4effd700 1 -- 172.21.15.43:0/538411960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c16b5fa60 con 0x563c16cbea80 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.181+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 0x7f4f380a64b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006130 tx=0x7f4f48009380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.181+0000 7f4f4effd700 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f400097a0 tx=0x7f4f4009cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddd953b656df95b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.181+0000 7f4f35ffb700 1 -- 172.21.15.43:0/538411960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a09a0 con 0x563c16cbea80 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.181+0000 7f4f35ffb700 1 -- 172.21.15.43:0/538411960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f400b4070 con 0x563c16cbea80 2024-04-25T20:51:05.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f35ffb700 1 -- 172.21.15.43:0/538411960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a4dd0 con 0x563c16cbea80 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 -- 172.21.15.43:0/538411960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 msgr2=0x563c16cbee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f400097a0 tx=0x7f4f4009cd70 comp rx=0 tx=0).stop 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 -- 172.21.15.43:0/538411960 shutdown_connections 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16ccc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbea80 0x563c16cbee60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 --2- 172.21.15.43:0/538411960 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 -- 172.21.15.43:0/538411960 >> 172.21.15.43:0/538411960 conn(0x563c16bec820 msgr2=0x563c16cbaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 -- 172.21.15.43:0/538411960 shutdown_connections 2024-04-25T20:51:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.182+0000 7f4f60141b80 1 -- 172.21.15.43:0/538411960 wait complete. 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.183+0000 7f4f60141b80 1 -- start start 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.183+0000 7f4f60141b80 1 Processor -- start 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.183+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16cc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cc9da0 0x563c16cc72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:50832/0 (socket says 172.21.15.43:50832) 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 -- 172.21.15.43:0/1086623457 learned_addr learned my addr 172.21.15.43:0/1086623457 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cc9da0 0x563c16cc72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563c16ccccc0 con 0x563c16cc9da0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563c16bb0d60 con 0x563c16cbf3a0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x563c16ccce40 con 0x563c16cca270 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16cc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 -- 172.21.15.43:0/1086623457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 msgr2=0x563c16cc6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16cc6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 -- 172.21.15.43:0/1086623457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cc9da0 msgr2=0x563c16cc72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cc9da0 0x563c16cc72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f4effd700 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c16bc9400 con 0x563c16cbf3a0 2024-04-25T20:51:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.184+0000 7f4f60141b80 10 client.0 _ll_register_callbacks cb 0x563c16baaae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f4009c2f0 tx=0x7f4f4009c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40cc064a2232f874 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f2effd700 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f400b4070 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f2effd700 1 -- 172.21.15.43:0/1086623457 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f400bb020 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f2effd700 1 -- 172.21.15.43:0/1086623457 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f4009c850 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f2effd700 1 -- 172.21.15.43:0/1086623457 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f400a5260 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 10 client.25181 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563c16cd0f40 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f2effd700 1 -- 172.21.15.43:0/1086623457 <== mon.2 v2:172.21.15.112:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4f400a4dd0 con 0x563c16cbf3a0 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 10 client.25181 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 10 client.25181 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 20 client.25181 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16ce4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 4 client.25181 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:05.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.185+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4f400b4070 con 0x563c16ce25a0 2024-04-25T20:51:05.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.186+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16ce4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.186+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16ce4990 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9167fd6e3eeb3c8 server_cookie=f7c928250fb459ff in_seq=0 out_seq=0 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.186+0000 7f4f2effd700 10 client.25181 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f2effd700 1 -- 172.21.15.43:0/1086623457 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f4f400b4070 con 0x563c16ce25a0 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f2effd700 10 client.25181 handle_command_reply: tid=0 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 client.25181 shutdown 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 msgr2=0x563c16cc9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f4009c2f0 tx=0x7f4f4009c730 comp rx=0 tx=0).stop 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 shutdown_connections 2024-04-25T20:51:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16ce4990 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f2effd700 0 client.25181 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cc9da0 0x563c16cc72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cbf3a0 0x563c16cc9860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1086623457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cca270 0x563c16cc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 >> 172.21.15.43:0/1086623457 conn(0x563c16bec820 msgr2=0x563c16cbab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 shutdown_connections 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.187+0000 7f4f60141b80 1 -- 172.21.15.43:0/1086623457 wait complete. 2024-04-25T20:51:05.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.188+0000 7f4f60141b80 20 client.25181 trim_cache size 0 max 16384 2024-04-25T20:51:05.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 Processor -- start 2024-04-25T20:51:05.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 -- start start 2024-04-25T20:51:05.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 0x563c16cbb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 0x563c16cc95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cca270 0x563c16cc4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.227+0000 7f4f60141b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00d420 con 0x563c16cbf3a0 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f60141b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00ef60 con 0x563c16cca270 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 0x563c16cbb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f60141b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00daf0 con 0x563c16cc9da0 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 0x563c16cbb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34330/0 (socket says 172.21.15.43:34330) 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4effd700 1 -- 172.21.15.43:0/1760840367 learned_addr learned my addr 172.21.15.43:0/1760840367 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 0x563c16cc95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cca270 0x563c16cc4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1760840367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cca270 msgr2=0x563c16cc4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cca270 0x563c16cc4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1760840367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 msgr2=0x563c16cbb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 0x563c16cbb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1760840367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c16cc6400 con 0x563c16cc9da0 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.228+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 0x563c16cc95f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x563c16cccf30 tx=0x7f4f44009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da9c5b19b3d4143f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.229+0000 7f4f357fa700 1 -- 172.21.15.43:0/1760840367 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f440121d0 con 0x563c16cc9da0 2024-04-25T20:51:05.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.229+0000 7f4f357fa700 1 -- 172.21.15.43:0/1760840367 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f44012370 con 0x563c16cc9da0 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.229+0000 7f4f357fa700 1 -- 172.21.15.43:0/1760840367 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44005280 con 0x563c16cc9da0 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 -- 172.21.15.43:0/1760840367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 msgr2=0x563c16cc95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 0x563c16cc95f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x563c16cccf30 tx=0x7f4f44009260 comp rx=0 tx=0).stop 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 -- 172.21.15.43:0/1760840367 shutdown_connections 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cca270 0x563c16cc4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cbf3a0 0x563c16cbb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1760840367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cc9da0 0x563c16cc95f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 -- 172.21.15.43:0/1760840367 >> 172.21.15.43:0/1760840367 conn(0x563c16bec820 msgr2=0x563c16cc6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 -- 172.21.15.43:0/1760840367 shutdown_connections 2024-04-25T20:51:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.230+0000 7f4f60141b80 1 -- 172.21.15.43:0/1760840367 wait complete. 2024-04-25T20:51:05.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.231+0000 7f4f60141b80 1 -- start start 2024-04-25T20:51:05.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.231+0000 7f4f60141b80 1 Processor -- start 2024-04-25T20:51:05.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 0x563c16cd9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 0x563c16cda2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f60141b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cca270 0x563c16cda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f60141b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00e890 con 0x563c16cca270 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 0x563c16cd9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 0x563c16cd9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:33714/0 (socket says 172.21.15.43:33714) 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f4effd700 1 -- 172.21.15.43:0/1185020773 learned_addr learned my addr 172.21.15.43:0/1185020773 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 0x563c16cda2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f4f7fe700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cca270 0x563c16cda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.232+0000 7f4f60141b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00e1c0 con 0x563c16cc9da0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00b3c0 con 0x563c16cbf3a0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f60141b80 10 client.0 _ll_register_callbacks cb 0x563c16baaae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1185020773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 msgr2=0x563c16cd9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 0x563c16cd9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1185020773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cca270 msgr2=0x563c16cda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cca270 0x563c16cda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 -- 172.21.15.43:0/1185020773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c16d48770 con 0x563c16cc9da0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c16c1f6b0 con 0x563c16cc9da0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f4e7fc700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 0x563c16cda2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f44006010 tx=0x7f4f44004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6577f1c5b59d080 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f2effd700 10 client.25187 ms_handle_connect on v2:172.21.15.112:3300/0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.233+0000 7f4f2effd700 1 -- 172.21.15.43:0/1185020773 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44012650 con 0x563c16cc9da0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.234+0000 7f4f2effd700 1 -- 172.21.15.43:0/1185020773 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f44004750 con 0x563c16cc9da0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.234+0000 7f4f2effd700 1 -- 172.21.15.43:0/1185020773 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f440049b0 con 0x563c16cc9da0 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.234+0000 7f4f60141b80 10 client.25187 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:05.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.234+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({fsmap=28}) -- 0x563c16d498f0 con 0x563c16cc9da0 2024-04-25T20:51:05.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.234+0000 7f4f2effd700 1 -- 172.21.15.43:0/1185020773 <== mon.2 v2:172.21.15.112:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4f44005020 con 0x563c16cc9da0 2024-04-25T20:51:05.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 10 client.25187 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:05.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 10 client.25187 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 20 client.25187 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16d4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 4 client.25187 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.2, "await_for": 42.0}] 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.2, "await_for": 42.0}) -- 0x563c16c1f6b0 con 0x563c16ce25a0 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.235+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16d4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.236+0000 7f4f4effd700 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16d4bdc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b5c95f2a986f1b server_cookie=5e0262a8652e253c in_seq=0 out_seq=0 2024-04-25T20:51:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.236+0000 7f4f2effd700 10 client.25187 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.244+0000 7f4f2effd700 1 -- 172.21.15.43:0/1185020773 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x563c16c1f6b0 con 0x563c16ce25a0 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.244+0000 7f4f2effd700 10 client.25187 handle_command_reply: tid=0 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.244+0000 7f4f60141b80 1 client.25187 shutdown 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 msgr2=0x563c16cda2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 0x563c16cda2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f44006010 tx=0x7f4f44004280 comp rx=0 tx=0).stop 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 shutdown_connections 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x563c16ce25a0 0x563c16d4bdc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563c16cbf3a0 0x563c16cd9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c16cca270 0x563c16cda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f2effd700 0 client.25187 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 --2- 172.21.15.43:0/1185020773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563c16cc9da0 0x563c16cda2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 >> 172.21.15.43:0/1185020773 conn(0x563c16bec820 msgr2=0x563c16cc08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 shutdown_connections 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 1 -- 172.21.15.43:0/1185020773 wait complete. 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.245+0000 7f4f60141b80 20 client.25187 trim_cache size 0 max 16384 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:51:05.247 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 28, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "leader": 24470, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "set_version": 2, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "sets": { 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "c49d1494": { 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "version": 2, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "age_ref": 0.0, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "QUIESCED", 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "timeout": 60.0, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "expiration": 86.2, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "members": { 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "file:/": { 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "excluded": false, 2024-04-25T20:51:05.248 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "QUIESCED", 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:51:05.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 msgr2=0x7f4f380a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 0x7f4f380a64b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006130 tx=0x7f4f48009380 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 msgr2=0x7f4f501991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000d980 tx=0x7f4f4000dc90 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 shutdown_connections 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f380a3ff0 0x7f4f380a64b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f50108a50 0x7f4f5019da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f5006aff0 0x7f4f501991a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 --2- 172.21.15.43:0/1020042893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f5006b990 0x7f4f501996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 >> 172.21.15.43:0/1020042893 conn(0x7f4f50078980 msgr2=0x7f4f500ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.246+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 shutdown_connections 2024-04-25T20:51:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:05.247+0000 7f4f558b8700 1 -- 172.21.15.43:0/1020042893 wait complete. 2024-04-25T20:51:05.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:51:05.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:04 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:51:05.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:04 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:51:06.093 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c49d1494', quiesce took 6.8 seconds. Will release after: 26.2 2024-04-25T20:51:06.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:05 smithi043 ceph-mon[29167]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-25T20:51:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:05 smithi195 ceph-mon[33250]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-25T20:51:06.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:05 smithi112 ceph-mon[32322]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 -- 172.21.15.43:0/3984951199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103a20 msgr2=0x7f66f410bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/3984951199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103a20 0x7f66f410bf00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009900 tx=0x7f66dc02a480 comp rx=0 tx=0).stop 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 -- 172.21.15.43:0/3984951199 shutdown_connections 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/3984951199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 0x7f66f410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/3984951199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103a20 0x7f66f410bf00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/3984951199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103100 0x7f66f41034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 -- 172.21.15.43:0/3984951199 >> 172.21.15.43:0/3984951199 conn(0x7f66f40fc920 msgr2=0x7f66f40fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 -- 172.21.15.43:0/3984951199 shutdown_connections 2024-04-25T20:51:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.503+0000 7f66f9ae8640 1 -- 172.21.15.43:0/3984951199 wait complete. 2024-04-25T20:51:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 Processor -- start 2024-04-25T20:51:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 -- start start 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103a20 0x7f66f4101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 0x7f66f41017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41122f0 con 0x7f66f4103100 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4112170 con 0x7f66f4103a20 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f9ae8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4112470 con 0x7f66f410c520 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37970/0 (socket says 172.21.15.43:37970) 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f37fe640 1 -- 172.21.15.43:0/205784237 learned_addr learned my addr 172.21.15.43:0/205784237 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f3fff640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 0x7f66f41017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.504+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103a20 0x7f66f4101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 -- 172.21.15.43:0/205784237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 msgr2=0x7f66f41017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 0x7f66f41017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 -- 172.21.15.43:0/205784237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103a20 msgr2=0x7f66f4101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103a20 0x7f66f4101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 -- 172.21.15.43:0/205784237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f41a6bb0 con 0x7f66f4103100 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f37fe640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c920 tx=0x7f66e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f0ff9640 1 -- 172.21.15.43:0/205784237 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4007c70 con 0x7f66f4103100 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f0ff9640 1 -- 172.21.15.43:0/205784237 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66e4007e10 con 0x7f66f4103100 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f41a6ea0 con 0x7f66f4103100 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f0ff9640 1 -- 172.21.15.43:0/205784237 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e40188c0 con 0x7f66f4103100 2024-04-25T20:51:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.505+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f41a7360 con 0x7f66f4103100 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.507+0000 7f66f0ff9640 1 -- 172.21.15.43:0/205784237 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f66e4018a60 con 0x7f66f4103100 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 Processor -- start 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 -- start start 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f0ff9640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 0x7f66e00a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd73800 0x5654edd75bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654edccd970 con 0x5654edd68620 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5654edc6a4a0 con 0x5654edd73800 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66fc803740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5654edcc9930 con 0x5654edd68f40 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f37fe640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 0x7f66e00a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37974/0 (socket says 172.21.15.43:37974) 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f3fff640 1 -- 172.21.15.43:0/1454214345 learned_addr learned my addr 172.21.15.43:0/1454214345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f0ff9640 1 -- 172.21.15.43:0/205784237 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f66e40d0bc0 con 0x7f66f4103100 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.508+0000 7f66f3fff640 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd73800 0x5654edd75bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 -- 172.21.15.43:0/1454214345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 msgr2=0x5654edd732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 -- 172.21.15.43:0/1454214345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd73800 msgr2=0x5654edd75bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd73800 0x5654edd75bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 -- 172.21.15.43:0/1454214345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ed9e0210 con 0x5654edd68620 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f37fe640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 0x7f66e00a63d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66e40ce1c0 tx=0x7f66e400ff10 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66f3fff640 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0134e0 tx=0x7f66ec00a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbae470f8ec0da65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66e9ffb640 1 -- 172.21.15.43:0/1454214345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004d20 con 0x5654edd68620 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66e9ffb640 1 -- 172.21.15.43:0/1454214345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66ec017070 con 0x5654edd68620 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.509+0000 7f66e9ffb640 1 -- 172.21.15.43:0/1454214345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec004770 con 0x5654edd68620 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- 172.21.15.43:0/1454214345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 msgr2=0x5654edd68a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0134e0 tx=0x7f66ec00a980 comp rx=0 tx=0).stop 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- 172.21.15.43:0/1454214345 shutdown_connections 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd73800 0x5654edd75bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 --2- 172.21.15.43:0/1454214345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68620 0x5654edd68a00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- 172.21.15.43:0/1454214345 >> 172.21.15.43:0/1454214345 conn(0x5654edd64b30 msgr2=0x5654edd64f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- 172.21.15.43:0/1454214345 shutdown_connections 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- 172.21.15.43:0/1454214345 wait complete. 2024-04-25T20:51:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.510+0000 7f66fc803740 1 -- start start 2024-04-25T20:51:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 Processor -- start 2024-04-25T20:51:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd73180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5654edd76430 con 0x5654edd68f40 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5654edc680b0 con 0x5654edd68620 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5654edd765b0 con 0x5654edd73800 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66fc803740 10 client.0 _ll_register_callbacks cb 0x5654edc55d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37976/0 (socket says 172.21.15.43:37976) 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66f2ffd640 1 -- 172.21.15.43:0/248871237 learned_addr learned my addr 172.21.15.43:0/248871237 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66f3fff640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.511+0000 7f66f3fff640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 -- 172.21.15.43:0/248871237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 msgr2=0x5654edd709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 -- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 msgr2=0x5654edd73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd73180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 -- 172.21.15.43:0/248871237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654edaac620 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f3fff640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02a9a0 tx=0x7f66dc031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a667b2642a4574c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc035040 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f66dc004040 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ec017070 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66dc004240 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66fc803740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654edd82380 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.512+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66ec017070 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f66dc045610 con 0x5654edd68f40 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 20 client.15504 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654edd85be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 4 client.15504 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654edcdb390 con 0x5654edd837f0 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66f3fff640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654edd85be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66f3fff640 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654edd85be0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa064c43fedcaa41 server_cookie=5076442dc714986e in_seq=0 out_seq=0 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.513+0000 7f66d2ffd640 10 client.15504 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66d2ffd640 1 -- 172.21.15.43:0/248871237 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5654edcdb390 con 0x5654edd837f0 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66d2ffd640 10 client.15504 handle_command_reply: tid=0 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 client.15504 shutdown 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 msgr2=0x5654edd70470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02a9a0 tx=0x7f66dc031740 comp rx=0 tx=0).stop 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 shutdown_connections 2024-04-25T20:51:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654edd85be0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd70470 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66d2ffd640 0 client.15504 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 --2- 172.21.15.43:0/248871237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 >> 172.21.15.43:0/248871237 conn(0x5654edd64b30 msgr2=0x5654edd6a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 shutdown_connections 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.514+0000 7f66fc803740 1 -- 172.21.15.43:0/248871237 wait complete. 2024-04-25T20:51:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.515+0000 7f66fc803740 20 client.15504 trim_cache size 0 max 16384 2024-04-25T20:51:06.531 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 Processor -- start 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 -- start start 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd7f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd8b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41afd80 con 0x5654edd73800 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41b18c0 con 0x5654edd68620 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66fc803740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41b0450 con 0x5654edd68f40 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37992/0 (socket says 172.21.15.43:37992) 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 -- 172.21.15.43:0/3569994552 learned_addr learned my addr 172.21.15.43:0/3569994552 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd7f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd8b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.532 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 -- 172.21.15.43:0/3569994552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 msgr2=0x5654edd8b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd8b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 -- 172.21.15.43:0/3569994552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 msgr2=0x5654edd7f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd7f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.530+0000 7f66f3fff640 1 -- 172.21.15.43:0/3569994552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654edd5f090 con 0x5654edd73800 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66f3fff640 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00ad30 tx=0x7f66ec01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc59f4bbfa3fc0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66e97fa640 1 -- 172.21.15.43:0/3569994552 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec024040 con 0x5654edd73800 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66e97fa640 1 -- 172.21.15.43:0/3569994552 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66ec017070 con 0x5654edd73800 2024-04-25T20:51:06.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66e97fa640 1 -- 172.21.15.43:0/3569994552 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec003bd0 con 0x5654edd73800 2024-04-25T20:51:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66fc803740 1 -- 172.21.15.43:0/3569994552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 msgr2=0x5654edd8ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.531+0000 7f66fc803740 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00ad30 tx=0x7f66ec01d040 comp rx=0 tx=0).stop 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- 172.21.15.43:0/3569994552 shutdown_connections 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd73800 0x5654edd8ba30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd68f40 0x5654edd8b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- 172.21.15.43:0/3569994552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd7f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- 172.21.15.43:0/3569994552 >> 172.21.15.43:0/3569994552 conn(0x5654edd64b30 msgr2=0x5654edd63cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- 172.21.15.43:0/3569994552 shutdown_connections 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- 172.21.15.43:0/3569994552 wait complete. 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- start start 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 Processor -- start 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd794c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41b11f0 con 0x5654edd68f40 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41b0b20 con 0x5654edd68620 2024-04-25T20:51:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.532+0000 7f66fc803740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66f41add60 con 0x5654edd73800 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66fc803740 10 client.0 _ll_register_callbacks cb 0x7f66dc005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38000/0 (socket says 172.21.15.43:38000) 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 -- 172.21.15.43:0/782529023 learned_addr learned my addr 172.21.15.43:0/782529023 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f3fff640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f3fff640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 -- 172.21.15.43:0/782529023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 msgr2=0x5654edd79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd79f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 -- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 msgr2=0x5654edd794c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd794c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 -- 172.21.15.43:0/782529023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654edd75bf0 con 0x5654edd68f40 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f3fff640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd794c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66f2ffd640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02a4c0 tx=0x7f66dc02ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b828198bc0acd08f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc035070 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f66dc045480 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.533+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66ec017070 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66dc045680 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654eddea0e0 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66ec017070 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f66dc060450 con 0x5654edd68f40 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 20 client.15510 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654eddec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 4 client.15510 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654edcd5200 con 0x5654edd837f0 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.534+0000 7f66f3fff640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654eddec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.535+0000 7f66f3fff640 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654eddec8a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4335400fafd1fa server_cookie=652c358e5e30d511 in_seq=0 out_seq=0 2024-04-25T20:51:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.535+0000 7f66d2ffd640 10 client.15510 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66d2ffd640 1 -- 172.21.15.43:0/782529023 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654edcd5200 con 0x5654edd837f0 2024-04-25T20:51:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66d2ffd640 10 client.15510 handle_command_reply: tid=0 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 client.15510 shutdown 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 msgr2=0x5654edd79a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f66dc02a4c0 tx=0x7f66dc02ab90 comp rx=0 tx=0).stop 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 shutdown_connections 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5654edd837f0 0x5654eddec8a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654edd73800 0x5654edd79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5654edd68f40 0x5654edd79a00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66d2ffd640 0 client.15510 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 --2- 172.21.15.43:0/782529023 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5654edd68620 0x5654edd794c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.542+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 >> 172.21.15.43:0/782529023 conn(0x5654edd64b30 msgr2=0x5654edd7e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 shutdown_connections 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66fc803740 1 -- 172.21.15.43:0/782529023 wait complete. 2024-04-25T20:51:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66fc803740 20 client.15510 trim_cache size 0 max 16384 2024-04-25T20:51:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:51:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:51:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:51:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 msgr2=0x7f66e00a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 0x7f66e00a63d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66e40ce1c0 tx=0x7f66e400ff10 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 msgr2=0x7f66f4100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c920 tx=0x7f66e400cde0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 shutdown_connections 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f66e00a3f10 0x7f66e00a63d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66f410c520 0x7f66f41017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f66f4103a20 0x7f66f4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 --2- 172.21.15.43:0/205784237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66f4103100 0x7f66f4100d50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 >> 172.21.15.43:0/205784237 conn(0x7f66f40fc920 msgr2=0x7f66f40fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.543+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 shutdown_connections 2024-04-25T20:51:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:06.544+0000 7f66f9ae8640 1 -- 172.21.15.43:0/205784237 wait complete. 2024-04-25T20:51:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:07 smithi043 ceph-mon[29167]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:07 smithi195 ceph-mon[33250]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:07 smithi112 ceph-mon[32322]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:09.487 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to 'e221b808d285b9d02e54cc10c53c84188e8e41e3'. 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-04-25T20:51:09.488 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.489 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T20:51:09.489 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-04-25T20:51:09.489 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at e221b808d28 qa/suites/fs: add quiescer to the fs suite 2024-04-25T20:51:09.490 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T20:51:09.636 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T20:51:09.638 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T20:51:09.638 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T20:51:10.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:09 smithi043 ceph-mon[29167]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:10.296 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T20:51:10.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:09 smithi195 ceph-mon[33250]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:09 smithi112 ceph-mon[32322]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T20:51:10.354 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T20:51:10.396 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T20:51:10.398 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T20:51:10.398 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T20:51:10.437 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T20:51:10.441 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T20:51:10.441 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T20:51:10.457 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-04-25T20:51:10.458 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-04-25T20:51:10.458 DEBUG:teuthology.orchestra.run.smithi043:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e221b808d285b9d02e54cc10c53c84188e8e41e3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-04-25T20:51:12.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:11 smithi043 ceph-mon[29167]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T20:51:12.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:11 smithi195 ceph-mon[33250]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T20:51:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:11 smithi112 ceph-mon[32322]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T20:51:14.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:13 smithi043 ceph-mon[29167]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-25T20:51:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:13 smithi195 ceph-mon[33250]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-25T20:51:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:13 smithi112 ceph-mon[32322]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-25T20:51:16.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:15 smithi043 ceph-mon[29167]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-25T20:51:16.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:15 smithi195 ceph-mon[33250]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-25T20:51:16.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:15 smithi112 ceph-mon[32322]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 29 op/s 2024-04-25T20:51:18.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:17 smithi043 ceph-mon[29167]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:18.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:17 smithi195 ceph-mon[33250]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:18.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:17 smithi112 ceph-mon[32322]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 -- 172.21.15.43:0/1782635756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc106190 msgr2=0x7fcadc10dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 --2- 172.21.15.43:0/1782635756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc106190 0x7fcadc10dd60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009ca0 tx=0x7fcad402a8c0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 -- 172.21.15.43:0/1782635756 shutdown_connections 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 --2- 172.21.15.43:0/1782635756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc106190 0x7fcadc10dd60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 --2- 172.21.15.43:0/1782635756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc101a70 0x7fcadc105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 --2- 172.21.15.43:0/1782635756 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 0x7fcadc1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 -- 172.21.15.43:0/1782635756 >> 172.21.15.43:0/1782635756 conn(0x7fcadc077fd0 msgr2=0x7fcadc0783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 -- 172.21.15.43:0/1782635756 shutdown_connections 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.643+0000 7fcae1d87640 1 -- 172.21.15.43:0/1782635756 wait complete. 2024-04-25T20:51:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 Processor -- start 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 -- start start 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 0x7fcadc0fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc106190 0x7fcadc0ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc111210 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc111090 con 0x7fcadc1010c0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.644+0000 7fcae1d87640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc111390 con 0x7fcadc106190 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51730/0 (socket says 172.21.15.43:51730) 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 -- 172.21.15.43:0/4226932310 learned_addr learned my addr 172.21.15.43:0/4226932310 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadaffd640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc106190 0x7fcadc0ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 0x7fcadc0fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 -- 172.21.15.43:0/4226932310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc106190 msgr2=0x7fcadc0ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc106190 0x7fcadc0ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 -- 172.21.15.43:0/4226932310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 msgr2=0x7fcadc0fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 0x7fcadc0fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 -- 172.21.15.43:0/4226932310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc1a6f60 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcadbfff640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005e30 tx=0x7fcad4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcad8ff9640 1 -- 172.21.15.43:0/4226932310 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4031650 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcad8ff9640 1 -- 172.21.15.43:0/4226932310 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcad40317f0 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc1a71f0 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.645+0000 7fcad8ff9640 1 -- 172.21.15.43:0/4226932310 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad402f9d0 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.646+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc1a7740 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcad8ff9640 1 -- 172.21.15.43:0/4226932310 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fcad402fbd0 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 Processor -- start 2024-04-25T20:51:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 -- start start 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7dea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7decbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555be7d44970 con 0x555be7ddf620 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555be7ce14a0 con 0x555be7ddff40 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555be7d40930 con 0x555be7dea800 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcad8ff9640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 0x7fcac80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51736/0 (socket says 172.21.15.43:51736) 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.648+0000 7fcadaffd640 1 -- 172.21.15.43:0/3499372529 learned_addr learned my addr 172.21.15.43:0/3499372529 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadbfff640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 0x7fcac80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7dea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcad8ff9640 1 -- 172.21.15.43:0/4226932310 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcad40f1d70 con 0x7fcadc0ff6c0 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7decbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 -- 172.21.15.43:0/3499372529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 msgr2=0x555be7decbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7decbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 -- 172.21.15.43:0/3499372529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 msgr2=0x555be7dea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7dea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 -- 172.21.15.43:0/3499372529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be7a57210 con 0x555be7ddf620 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcac400a5c0 tx=0x7fcac400a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8a576208b72994 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcadbfff640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 0x7fcac80a63a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcad40ef4e0 tx=0x7fcad40de040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcad1ffb640 1 -- 172.21.15.43:0/3499372529 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4019030 con 0x555be7ddf620 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcad1ffb640 1 -- 172.21.15.43:0/3499372529 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcac40110d0 con 0x555be7ddf620 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.649+0000 7fcad1ffb640 1 -- 172.21.15.43:0/3499372529 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac400f840 con 0x555be7ddf620 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3499372529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 msgr2=0x555be7ddfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcac400a5c0 tx=0x7fcac400a780 comp rx=0 tx=0).stop 2024-04-25T20:51:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3499372529 shutdown_connections 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7decbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7dea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3499372529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7ddfa00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3499372529 >> 172.21.15.43:0/3499372529 conn(0x555be7ddbb30 msgr2=0x555be7ddbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3499372529 shutdown_connections 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3499372529 wait complete. 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.650+0000 7fcae4b7b740 1 -- start start 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 Processor -- start 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddf620 0x555be7dea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555be7ded430 con 0x555be7dea800 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555be7cdf0b0 con 0x555be7ddf620 2024-04-25T20:51:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x555be7ded5b0 con 0x555be7ddff40 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcae4b7b740 10 client.0 _ll_register_callbacks cb 0x555be7cccd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51740/0 (socket says 172.21.15.43:51740) 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcadaffd640 1 -- 172.21.15.43:0/1902308773 learned_addr learned my addr 172.21.15.43:0/1902308773 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcadaffd640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddf620 0x555be7dea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.651+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 -- 172.21.15.43:0/1902308773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 msgr2=0x555be7de74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 -- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddf620 msgr2=0x555be7dea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddf620 0x555be7dea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 -- 172.21.15.43:0/1902308773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be7b23620 con 0x555be7dea800 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcadaffd640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ad40 tx=0x7fcac4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b92c15fd195db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.659 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcabaffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4019030 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcac4027070 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac40110d0 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcac4005020 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcae4b7b740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555be7df93a0 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.652+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcac40110d0 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fcac402a020 con 0x555be7dea800 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 20 client.15522 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7dfa7b0 0x555be7dfcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 4 client.15522 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555be7d52390 con 0x555be7dfa7b0 2024-04-25T20:51:19.660 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7dfa7b0 0x555be7dfcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcabaffd640 10 client.15522 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.653+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7dfa7b0 0x555be7dfcba0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac5176bd7f6cf65 server_cookie=bd34537777d9164f in_seq=0 out_seq=0 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcabaffd640 1 -- 172.21.15.43:0/1902308773 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555be7d52390 con 0x555be7dfa7b0 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcabaffd640 10 client.15522 handle_command_reply: tid=0 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 client.15522 shutdown 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 msgr2=0x555be7de7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ad40 tx=0x7fcac4015040 comp rx=0 tx=0).stop 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 shutdown_connections 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7dfa7b0 0x555be7dfcba0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7dea800 0x555be7de7a40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/1902308773 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddf620 0x555be7dea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcabaffd640 0 client.15522 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.654+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 >> 172.21.15.43:0/1902308773 conn(0x555be7ddbb30 msgr2=0x555be7de18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.655+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 shutdown_connections 2024-04-25T20:51:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.655+0000 7fcae4b7b740 1 -- 172.21.15.43:0/1902308773 wait complete. 2024-04-25T20:51:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.655+0000 7fcae4b7b740 20 client.15522 trim_cache size 0 max 16384 2024-04-25T20:51:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 Processor -- start 2024-04-25T20:51:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 -- start start 2024-04-25T20:51:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.671 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7dea800 0x555be7e022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1afca0 con 0x555be7ddf620 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1b17e0 con 0x555be7dea800 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1b0370 con 0x555be7ddff40 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51750/0 (socket says 172.21.15.43:51750) 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 -- 172.21.15.43:0/3776626636 learned_addr learned my addr 172.21.15.43:0/3776626636 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 -- 172.21.15.43:0/3776626636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 msgr2=0x555be7de9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 -- 172.21.15.43:0/3776626636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7dea800 msgr2=0x555be7e022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7dea800 0x555be7e022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 -- 172.21.15.43:0/3776626636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be7ddf3e0 con 0x555be7ddf620 2024-04-25T20:51:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.670+0000 7fcadaffd640 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcac4004fd0 tx=0x7fcac400af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6096a6c882e67ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcad17fa640 1 -- 172.21.15.43:0/3776626636 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4019030 con 0x555be7ddf620 2024-04-25T20:51:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcad17fa640 1 -- 172.21.15.43:0/3776626636 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcac4011e70 con 0x555be7ddf620 2024-04-25T20:51:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcad17fa640 1 -- 172.21.15.43:0/3776626636 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac400a630 con 0x555be7ddf620 2024-04-25T20:51:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3776626636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 msgr2=0x555be7df62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcac4004fd0 tx=0x7fcac400af80 comp rx=0 tx=0).stop 2024-04-25T20:51:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3776626636 shutdown_connections 2024-04-25T20:51:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7dea800 0x555be7e022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7ddff40 0x555be7de9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/3776626636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df62f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3776626636 >> 172.21.15.43:0/3776626636 conn(0x555be7ddbb30 msgr2=0x555be7ddacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3776626636 shutdown_connections 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.671+0000 7fcae4b7b740 1 -- 172.21.15.43:0/3776626636 wait complete. 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 -- start start 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 Processor -- start 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7de3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7de43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1b1110 con 0x555be7ddf620 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1b0a40 con 0x555be7ddff40 2024-04-25T20:51:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1adc80 con 0x555be7dea800 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcae4b7b740 10 client.0 _ll_register_callbacks cb 0x7fcac4011b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcadaffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51762/0 (socket says 172.21.15.43:51762) 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcadaffd640 1 -- 172.21.15.43:0/4130280939 learned_addr learned my addr 172.21.15.43:0/4130280939 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7de3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.672+0000 7fcadaffd640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7de43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 -- 172.21.15.43:0/4130280939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 msgr2=0x555be7de43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7de43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 -- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 msgr2=0x555be7de3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7de3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 -- 172.21.15.43:0/4130280939 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be7de4c20 con 0x555be7ddf620 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcadaffd640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcac400a940 tx=0x7fcac4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487fad894ab69590 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac403c020 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fcac40049e0 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac4011e70 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcac4019040 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcae4b7b740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555be7e60ab0 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcac4011e70 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.673+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fcac4035030 con 0x555be7ddf620 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 20 client.15528 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7e61160 0x555be7e63550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 4 client.15528 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555be7d4c200 con 0x555be7e61160 2024-04-25T20:51:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7e61160 0x555be7e63550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcabaffd640 10 client.15528 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.674+0000 7fcadb7fe640 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7e61160 0x555be7e63550 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d67178580d7e5f7 server_cookie=55b0fc98d66cadb9 in_seq=0 out_seq=0 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcabaffd640 1 -- 172.21.15.43:0/4130280939 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555be7d4c200 con 0x555be7e61160 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcabaffd640 10 client.15528 handle_command_reply: tid=0 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 client.15528 shutdown 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 msgr2=0x555be7df2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcac400a940 tx=0x7fcac4005b90 comp rx=0 tx=0).stop 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 shutdown_connections 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x555be7e61160 0x555be7e63550 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555be7dea800 0x555be7de43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555be7ddff40 0x555be7de3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcabaffd640 0 client.15528 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 --2- 172.21.15.43:0/4130280939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555be7ddf620 0x555be7df2bd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 >> 172.21.15.43:0/4130280939 conn(0x555be7ddbb30 msgr2=0x555be7de0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 shutdown_connections 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 1 -- 172.21.15.43:0/4130280939 wait complete. 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.680+0000 7fcae4b7b740 20 client.15528 trim_cache size 0 max 16384 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:51:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:51:19.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 msgr2=0x7fcac80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 0x7fcac80a63a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcad40ef4e0 tx=0x7fcad40de040 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 msgr2=0x7fcadc1a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005e30 tx=0x7fcad4003d80 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 shutdown_connections 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcac80a3ee0 0x7fcac80a63a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcadc0ff6c0 0x7fcadc1a68c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcadc106190 0x7fcadc0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 --2- 172.21.15.43:0/4226932310 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcadc1010c0 0x7fcadc0fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 >> 172.21.15.43:0/4226932310 conn(0x7fcadc077fd0 msgr2=0x7fcadc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 shutdown_connections 2024-04-25T20:51:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:19.681+0000 7fcae1d87640 1 -- 172.21.15.43:0/4226932310 wait complete. 2024-04-25T20:51:20.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:19 smithi043 ceph-mon[29167]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:20.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:19 smithi195 ceph-mon[33250]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:20.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:19 smithi112 ceph-mon[32322]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-04-25T20:51:22.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:21 smithi043 ceph-mon[29167]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-04-25T20:51:22.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:21 smithi195 ceph-mon[33250]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-04-25T20:51:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:21 smithi112 ceph-mon[32322]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-04-25T20:51:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:23 smithi043 ceph-mon[29167]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-25T20:51:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:23 smithi195 ceph-mon[33250]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-25T20:51:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:23 smithi112 ceph-mon[32322]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-25T20:51:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:26 smithi043 ceph-mon[29167]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-25T20:51:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:26 smithi195 ceph-mon[33250]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-25T20:51:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:26 smithi112 ceph-mon[32322]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1023 B/s wr, 13 op/s 2024-04-25T20:51:28.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:28 smithi043 ceph-mon[29167]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:28 smithi195 ceph-mon[33250]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:28 smithi112 ceph-mon[32322]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:30.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:30 smithi043 ceph-mon[29167]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:30 smithi195 ceph-mon[33250]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:30 smithi112 ceph-mon[32322]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-25T20:51:32.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:51:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:32 smithi043 ceph-mon[29167]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-25T20:51:32.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:32 smithi043 ceph-mon[29167]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T20:51:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:32 smithi195 ceph-mon[33250]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-25T20:51:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:32 smithi195 ceph-mon[33250]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T20:51:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:32 smithi112 ceph-mon[32322]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-04-25T20:51:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:32 smithi112 ceph-mon[32322]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-04-25T20:51:32.560 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 -- 172.21.15.43:0/2132703736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c102b70 msgr2=0x7fa05c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 --2- 172.21.15.43:0/2132703736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c102b70 0x7fa05c106bb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009900 tx=0x7fa04c02a410 comp rx=0 tx=0).stop 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 -- 172.21.15.43:0/2132703736 shutdown_connections 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 --2- 172.21.15.43:0/2132703736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c107290 0x7fa05c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 --2- 172.21.15.43:0/2132703736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c102b70 0x7fa05c106bb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 --2- 172.21.15.43:0/2132703736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c1021c0 0x7fa05c1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 -- 172.21.15.43:0/2132703736 >> 172.21.15.43:0/2132703736 conn(0x7fa05c0fda20 msgr2=0x7fa05c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 -- 172.21.15.43:0/2132703736 shutdown_connections 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.772+0000 7fa063805640 1 -- 172.21.15.43:0/2132703736 wait complete. 2024-04-25T20:51:32.775 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 Processor -- start 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 -- start start 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 0x7fa05c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 0x7fa05c1a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1122f0 con 0x7fa05c107290 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c112170 con 0x7fa05c074cd0 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa063805640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c112470 con 0x7fa05c1021c0 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32892/0 (socket says 172.21.15.43:32892) 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 -- 172.21.15.43:0/542779193 learned_addr learned my addr 172.21.15.43:0/542779193 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa0615a1640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 0x7fa05c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa061da2640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 0x7fa05c1a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 -- 172.21.15.43:0/542779193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 msgr2=0x7fa05c074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.776 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 0x7fa05c074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 -- 172.21.15.43:0/542779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 msgr2=0x7fa05c1a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 0x7fa05c1a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa060da0640 1 -- 172.21.15.43:0/542779193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c1a6fe0 con 0x7fa05c107290 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa0615a1640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 0x7fa05c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.773+0000 7fa061da2640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 0x7fa05c1a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa060da0640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005940 tx=0x7fa04c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa0527fc640 1 -- 172.21.15.43:0/542779193 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c03f030 con 0x7fa05c107290 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa0527fc640 1 -- 172.21.15.43:0/542779193 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa04c031910 con 0x7fa05c107290 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c1a7270 con 0x7fa05c107290 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa0527fc640 1 -- 172.21.15.43:0/542779193 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c035070 con 0x7fa05c107290 2024-04-25T20:51:32.777 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.774+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c1a7760 con 0x7fa05c107290 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.776+0000 7fa0527fc640 1 -- 172.21.15.43:0/542779193 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa04c042030 con 0x7fa05c107290 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 Processor -- start 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 -- start start 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0527fc640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 0x7fa0480a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 0x55e8ded0b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded0b800 0x55e8ded0dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e8dec65970 con 0x55e8ded00620 2024-04-25T20:51:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e8dec024a0 con 0x55e8ded00f40 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0665fb740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e8dec61930 con 0x55e8ded0b800 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa061da2640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 0x7fa0480a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0527fc640 1 -- 172.21.15.43:0/542779193 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa04c0f0d20 con 0x7fa05c107290 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32894/0 (socket says 172.21.15.43:32894) 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 -- 172.21.15.43:0/2222794879 learned_addr learned my addr 172.21.15.43:0/2222794879 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa061da2640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded0b800 0x55e8ded0dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 -- 172.21.15.43:0/2222794879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded0b800 msgr2=0x55e8ded0dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded0b800 0x55e8ded0dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 -- 172.21.15.43:0/2222794879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 msgr2=0x55e8ded0b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa060da0640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 0x55e8ded0b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 0x55e8ded0b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa0615a1640 1 -- 172.21.15.43:0/2222794879 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8de978210 con 0x55e8ded00620 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.777+0000 7fa060da0640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 0x55e8ded0b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa061da2640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 0x7fa0480a62b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa054005cc0 tx=0x7fa054014a30 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0615a1640 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa058005fd0 tx=0x7fa05800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b871f9b1a5f76e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0477fe640 1 -- 172.21.15.43:0/2222794879 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058016070 con 0x55e8ded00620 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0477fe640 1 -- 172.21.15.43:0/2222794879 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa0580054f0 con 0x55e8ded00620 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0477fe640 1 -- 172.21.15.43:0/2222794879 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0580116d0 con 0x55e8ded00620 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 -- 172.21.15.43:0/2222794879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 msgr2=0x55e8ded00a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa058005fd0 tx=0x7fa05800e6c0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 -- 172.21.15.43:0/2222794879 shutdown_connections 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded0b800 0x55e8ded0dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00f40 0x55e8ded0b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 --2- 172.21.15.43:0/2222794879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded00a00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.778+0000 7fa0665fb740 1 -- 172.21.15.43:0/2222794879 >> 172.21.15.43:0/2222794879 conn(0x55e8decfcb30 msgr2=0x55e8decfcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- 172.21.15.43:0/2222794879 shutdown_connections 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- 172.21.15.43:0/2222794879 wait complete. 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- start start 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 Processor -- start 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00620 0x55e8ded0b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded08340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e8ded0e430 con 0x55e8ded0b800 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e8dec000b0 con 0x55e8ded00620 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e8ded0e5b0 con 0x55e8ded00f40 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa0665fb740 10 client.0 _ll_register_callbacks cb 0x55e8debedd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa061da2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.779+0000 7fa061da2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32910/0 (socket says 172.21.15.43:32910) 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 -- 172.21.15.43:0/3073108465 learned_addr learned my addr 172.21.15.43:0/3073108465 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa060da0640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded08340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00620 0x55e8ded0b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 -- 172.21.15.43:0/3073108465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 msgr2=0x55e8ded08340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded08340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 -- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00620 msgr2=0x55e8ded0b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00620 0x55e8ded0b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 -- 172.21.15.43:0/3073108465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8dea44620 con 0x55e8ded0b800 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa060da0640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded08340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa061da2640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa054011cc0 tx=0x7fa054004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b344d4b88ac2abe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa044ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054024030 con 0x55e8ded0b800 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa054004b20 con 0x55e8ded0b800 2024-04-25T20:51:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0580054f0 con 0x55e8ded0b800 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa05402e050 con 0x55e8ded0b800 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa0665fb740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.780+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8ded1a1b0 con 0x55e8ded0b800 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa0580054f0 con 0x55e8ded0b800 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa05401f480 con 0x55e8ded0b800 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 20 client.15540 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded1b6c0 0x55e8ded1dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 4 client.15540 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8dec73390 con 0x55e8ded1b6c0 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded1b6c0 0x55e8ded1dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa044ff9640 10 client.15540 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.781+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded1b6c0 0x55e8ded1dab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add9909a95e59bad server_cookie=c04af791f25e5a4a in_seq=0 out_seq=0 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa044ff9640 1 -- 172.21.15.43:0/3073108465 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8dec73390 con 0x55e8ded1b6c0 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa044ff9640 10 client.15540 handle_command_reply: tid=0 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 client.15540 shutdown 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 msgr2=0x55e8ded08880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa054011cc0 tx=0x7fa054004ab0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 shutdown_connections 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded1b6c0 0x55e8ded1dab0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded0b800 0x55e8ded08880 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded08340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3073108465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8ded00620 0x55e8ded0b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa044ff9640 0 client.15540 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.782+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 >> 172.21.15.43:0/3073108465 conn(0x55e8decfcb30 msgr2=0x55e8ded028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.783+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 shutdown_connections 2024-04-25T20:51:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.783+0000 7fa0665fb740 1 -- 172.21.15.43:0/3073108465 wait complete. 2024-04-25T20:51:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.783+0000 7fa0665fb740 20 client.15540 trim_cache size 0 max 16384 2024-04-25T20:51:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 Processor -- start 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 -- start start 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00620 0x55e8ded233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1afd00 con 0x55e8ded00f40 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1b1840 con 0x55e8decfcb30 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa0665fb740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1b03d0 con 0x55e8ded00620 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa061da2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa061da2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32914/0 (socket says 172.21.15.43:32914) 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.798+0000 7fa061da2640 1 -- 172.21.15.43:0/1175471866 learned_addr learned my addr 172.21.15.43:0/1175471866 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa0615a1640 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa060da0640 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00620 0x55e8ded233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 -- 172.21.15.43:0/1175471866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00620 msgr2=0x55e8ded233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00620 0x55e8ded233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 -- 172.21.15.43:0/1175471866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 msgr2=0x55e8ded172f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded172f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 -- 172.21.15.43:0/1175471866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8decfc960 con 0x55e8ded00f40 2024-04-25T20:51:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.799+0000 7fa061da2640 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa054014f50 tx=0x7fa054008290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9a606963f99fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.800+0000 7fa046ffd640 1 -- 172.21.15.43:0/1175471866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054024070 con 0x55e8ded00f40 2024-04-25T20:51:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.800+0000 7fa046ffd640 1 -- 172.21.15.43:0/1175471866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa054037070 con 0x55e8ded00f40 2024-04-25T20:51:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.800+0000 7fa046ffd640 1 -- 172.21.15.43:0/1175471866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054020690 con 0x55e8ded00f40 2024-04-25T20:51:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- 172.21.15.43:0/1175471866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 msgr2=0x55e8ded23900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.805 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa054014f50 tx=0x7fa054008290 comp rx=0 tx=0).stop 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- 172.21.15.43:0/1175471866 shutdown_connections 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00f40 0x55e8ded23900 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00620 0x55e8ded233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 --2- 172.21.15.43:0/1175471866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- 172.21.15.43:0/1175471866 >> 172.21.15.43:0/1175471866 conn(0x55e8ded089e0 msgr2=0x55e8decfb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- 172.21.15.43:0/1175471866 shutdown_connections 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- 172.21.15.43:0/1175471866 wait complete. 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 -- start start 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.801+0000 7fa0665fb740 1 Processor -- start 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1b1170 con 0x55e8ded00620 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1b0aa0 con 0x55e8decfcb30 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1adce0 con 0x55e8ded00f40 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0665fb740 10 client.0 _ll_register_callbacks cb 0x7fa0540116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32928/0 (socket says 172.21.15.43:32928) 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 -- 172.21.15.43:0/3138874657 learned_addr learned my addr 172.21.15.43:0/3138874657 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa061da2640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 -- 172.21.15.43:0/3138874657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 msgr2=0x55e8ded112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 -- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 msgr2=0x55e8ded139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.802+0000 7fa060da0640 1 -- 172.21.15.43:0/3138874657 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8ded118c0 con 0x55e8ded00620 2024-04-25T20:51:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa060da0640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0ee500 tx=0x7fa04c0bc710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f7e53c7df69233 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c049040 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa04c0ee720 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa054037070 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa04c0c10a0 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8ded81a90 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa054037070 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa04c0a3a30 con 0x55e8ded00620 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 20 client.15546 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.803+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded0b800 0x55e8ded84200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.804+0000 7fa0665fb740 4 client.15546 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:51:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.804+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8dec6d200 con 0x55e8ded0b800 2024-04-25T20:51:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.804+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded0b800 0x55e8ded84200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.804+0000 7fa0615a1640 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded0b800 0x55e8ded84200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c0d1b5ff108fda server_cookie=414f53d4f8d54283 in_seq=0 out_seq=0 2024-04-25T20:51:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.804+0000 7fa044ff9640 10 client.15546 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa044ff9640 1 -- 172.21.15.43:0/3138874657 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8dec6d200 con 0x55e8ded0b800 2024-04-25T20:51:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa044ff9640 10 client.15546 handle_command_reply: tid=0 2024-04-25T20:51:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 client.15546 shutdown 2024-04-25T20:51:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 msgr2=0x55e8ded10d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0ee500 tx=0x7fa04c0bc710 comp rx=0 tx=0).stop 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 shutdown_connections 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e8ded0b800 0x55e8ded84200 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e8ded00f40 0x55e8ded112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e8ded00620 0x55e8ded10d90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 --2- 172.21.15.43:0/3138874657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e8decfcb30 0x55e8ded139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa044ff9640 0 client.15546 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 >> 172.21.15.43:0/3138874657 conn(0x55e8ded089e0 msgr2=0x55e8decfb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 shutdown_connections 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 1 -- 172.21.15.43:0/3138874657 wait complete. 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.810+0000 7fa0665fb740 20 client.15546 trim_cache size 0 max 16384 2024-04-25T20:51:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:51:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:51:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:51:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:51:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 msgr2=0x7fa0480a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 0x7fa0480a62b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa054005cc0 tx=0x7fa054014a30 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 msgr2=0x7fa05c074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005940 tx=0x7fa04c0042f0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 shutdown_connections 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0480a3df0 0x7fa0480a62b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa05c074cd0 0x7fa05c1a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c107290 0x7fa05c074790 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 --2- 172.21.15.43:0/542779193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa05c1021c0 0x7fa05c074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 >> 172.21.15.43:0/542779193 conn(0x7fa05c0fda20 msgr2=0x7fa05c0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 shutdown_connections 2024-04-25T20:51:32.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:32.811+0000 7fa063805640 1 -- 172.21.15.43:0/542779193 wait complete. 2024-04-25T20:51:34.283 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:34 smithi043 ceph-mon[29167]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:34 smithi195 ceph-mon[33250]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:34 smithi112 ceph-mon[32322]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- 172.21.15.43:0/4236051206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3006b0f0 msgr2=0x7f8a3010f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 --2- 172.21.15.43:0/4236051206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3006b0f0 0x7f8a3010f900 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b0a0 tx=0x7f8a2800b3b0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- 172.21.15.43:0/4236051206 shutdown_connections 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 --2- 172.21.15.43:0/4236051206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3006b0f0 0x7f8a3010f900 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 --2- 172.21.15.43:0/4236051206 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a30108a30 0x7f8a30108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 --2- 172.21.15.43:0/4236051206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3006abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- 172.21.15.43:0/4236051206 >> 172.21.15.43:0/4236051206 conn(0x7f8a300788f0 msgr2=0x7f8a30078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- 172.21.15.43:0/4236051206 shutdown_connections 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- 172.21.15.43:0/4236051206 wait complete. 2024-04-25T20:51:34.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 Processor -- start 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 -- start start 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.388+0000 7f8a38375700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a3006b0f0 0x7f8a3019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30112d50 con 0x7f8a30108a30 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30112bd0 con 0x7f8a3006b0f0 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30112ed0 con 0x7f8a3006a750 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:32948/0 (socket says 172.21.15.43:32948) 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 -- 172.21.15.43:0/2742390755 learned_addr learned my addr 172.21.15.43:0/2742390755 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a35910700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a3006b0f0 0x7f8a3019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36111700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:34.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 -- 172.21.15.43:0/2742390755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 msgr2=0x7f8a3019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 -- 172.21.15.43:0/2742390755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a3006b0f0 msgr2=0x7f8a3019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a3006b0f0 0x7f8a3019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 -- 172.21.15.43:0/2742390755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a301a03a0 con 0x7f8a30108a30 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36111700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a36912700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b070 tx=0x7f8a28007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28021070 con 0x7f8a30108a30 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a301a0630 con 0x7f8a30108a30 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a2801db20 con 0x7f8a30108a30 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2801bc50 con 0x7f8a30108a30 2024-04-25T20:51:34.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.389+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a301a7f10 con 0x7f8a30108a30 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.391+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a30069730 con 0x7f8a30108a30 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.392+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8a28024070 con 0x7f8a30108a30 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.392+0000 7f8a277fe700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 0x7f8a1c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.392+0000 7f8a36111700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 0x7f8a1c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.392+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f8a2800f020 con 0x7f8a30108a30 2024-04-25T20:51:34.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.393+0000 7f8a36111700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 0x7f8a1c0a6270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00baa0 tx=0x7f8a2c005db0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:34.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.397+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8a2802b020 con 0x7f8a30108a30 2024-04-25T20:51:34.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.651+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a3019c6f0 con 0x7f8a30108a30 2024-04-25T20:51:34.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.652+0000 7f8a277fe700 1 -- 172.21.15.43:0/2742390755 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f8a2809e5c0 con 0x7f8a30108a30 2024-04-25T20:51:34.653 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:51:34.654 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:51:34.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 msgr2=0x7f8a1c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:34.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 0x7f8a1c0a6270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00baa0 tx=0x7f8a2c005db0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 msgr2=0x7f8a3019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800b070 tx=0x7f8a28007ad0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 shutdown_connections 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f8a1c0a3db0 0x7f8a1c0a6270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a3006a750 0x7f8a3019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a30108a30 0x7f8a3019fc60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 --2- 172.21.15.43:0/2742390755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8a3006b0f0 0x7f8a3019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:34.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 >> 172.21.15.43:0/2742390755 conn(0x7f8a300788f0 msgr2=0x7f8a3010de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:34.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 shutdown_connections 2024-04-25T20:51:34.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:34.654+0000 7f8a38375700 1 -- 172.21.15.43:0/2742390755 wait complete. 2024-04-25T20:51:34.658 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:51:35.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:35 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2742390755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:35.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:35 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2742390755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:35.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:35 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2742390755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:35.688 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24470 quiesce db --set-id c49d1494 --release --await' 2024-04-25T20:51:35.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24470 quiesce db --set-id c49d1494 --release --await 2024-04-25T20:51:35.943 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:36.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:36 smithi043 ceph-mon[29167]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-25T20:51:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:36 smithi195 ceph-mon[33250]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-25T20:51:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:36 smithi112 ceph-mon[32322]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-25T20:51:37.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 -- 172.21.15.43:0/4016878427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac102330 msgr2=0x7f24ac10e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 --2- 172.21.15.43:0/4016878427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac102330 0x7f24ac10e7f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b0a0 tx=0x7f24a400b3b0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 -- 172.21.15.43:0/4016878427 shutdown_connections 2024-04-25T20:51:37.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 --2- 172.21.15.43:0/4016878427 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac107920 0x7f24ac107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 --2- 172.21.15.43:0/4016878427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac102330 0x7f24ac10e7f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.772+0000 7f24b2300700 1 --2- 172.21.15.43:0/4016878427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac101970 0x7f24ac101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.773+0000 7f24b2300700 1 -- 172.21.15.43:0/4016878427 >> 172.21.15.43:0/4016878427 conn(0x7f24ac0788f0 msgr2=0x7f24ac078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.773+0000 7f24b2300700 1 -- 172.21.15.43:0/4016878427 shutdown_connections 2024-04-25T20:51:37.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.773+0000 7f24b2300700 1 -- 172.21.15.43:0/4016878427 wait complete. 2024-04-25T20:51:37.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.773+0000 7f24b2300700 1 Processor -- start 2024-04-25T20:51:37.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.773+0000 7f24b2300700 1 -- start start 2024-04-25T20:51:37.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 0x7f24ac199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac102330 0x7f24ac199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac111d50 con 0x7f24ac107920 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac111bd0 con 0x7f24ac102330 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b2300700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac111ed0 con 0x7f24ac101970 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58426/0 (socket says 172.21.15.43:58426) 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 -- 172.21.15.43:0/3784673647 learned_addr learned my addr 172.21.15.43:0/3784673647 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24abfff700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 0x7f24ac199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac102330 0x7f24ac199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 -- 172.21.15.43:0/3784673647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 msgr2=0x7f24ac199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 0x7f24ac199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 -- 172.21.15.43:0/3784673647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac102330 msgr2=0x7f24ac199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac102330 0x7f24ac199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 -- 172.21.15.43:0/3784673647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac19e360 con 0x7f24ac107920 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24abfff700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 0x7f24ac199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.774+0000 7f24b089d700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b070 tx=0x7f24a4007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.775+0000 7f24a97fa700 1 -- 172.21.15.43:0/3784673647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4022070 con 0x7f24ac107920 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.775+0000 7f24a97fa700 1 -- 172.21.15.43:0/3784673647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f24a4003c00 con 0x7f24ac107920 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.775+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac19e5f0 con 0x7f24ac107920 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.775+0000 7f24a97fa700 1 -- 172.21.15.43:0/3784673647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a401d9e0 con 0x7f24ac107920 2024-04-25T20:51:37.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.775+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1a5ed0 con 0x7f24ac107920 2024-04-25T20:51:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.778+0000 7f24a97fa700 1 -- 172.21.15.43:0/3784673647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f24a40056c0 con 0x7f24ac107920 2024-04-25T20:51:37.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.778+0000 7f24a97fa700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 0x7f24940a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.778+0000 7f24abfff700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 0x7f24940a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.778+0000 7f24a97fa700 1 -- 172.21.15.43:0/3784673647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f24a400f020 con 0x7f24ac107920 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24abfff700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 0x7f24940a6270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f249c0099d0 tx=0x7f249c008040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 Processor -- start 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 -- start start 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4db280 0x556a8b4dd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556a8b41ed90 con 0x556a8b4cbf70 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556a8b3c5a30 con 0x556a8b4cb650 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556a8b41ad50 con 0x556a8b4db280 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58438/0 (socket says 172.21.15.43:58438) 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2773913776 learned_addr learned my addr 172.21.15.43:0/2773913776 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24abfff700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.779+0000 7f24b089d700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4db280 0x556a8b4dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2773913776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4db280 msgr2=0x556a8b4dd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4db280 0x556a8b4dd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2773913776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 msgr2=0x556a8b4cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2773913776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8b389840 con 0x556a8b4cbf70 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24abfff700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f24a00077f0 tx=0x7f24a0007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f95d1968b90a5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24927fc700 1 -- 172.21.15.43:0/2773913776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a00125f0 con 0x556a8b4cbf70 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24927fc700 1 -- 172.21.15.43:0/2773913776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f24a0018070 con 0x556a8b4cbf70 2024-04-25T20:51:37.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.780+0000 7f24927fc700 1 -- 172.21.15.43:0/2773913776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0013d00 con 0x556a8b4cbf70 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2773913776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 msgr2=0x556a8b4dad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f24a00077f0 tx=0x7f24a0007b00 comp rx=0 tx=0).stop 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2773913776 shutdown_connections 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4db280 0x556a8b4dd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2773913776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4dad40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2773913776 >> 172.21.15.43:0/2773913776 conn(0x556a8b3f8990 msgr2=0x556a8b4c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2773913776 shutdown_connections 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2773913776 wait complete. 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 -- start start 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.781+0000 7f24bcb89b80 1 Processor -- start 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cb650 0x556a8b4da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4d8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556a8b4ddd10 con 0x556a8b4cbf70 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556a8b3d86b0 con 0x556a8b4db280 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556a8b4dde90 con 0x556a8b4cb650 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24bcb89b80 10 client.0 _ll_register_callbacks cb 0x556a8b3b7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58444/0 (socket says 172.21.15.43:58444) 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2408706556 learned_addr learned my addr 172.21.15.43:0/2408706556 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24b089d700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4d8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24abfff700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cb650 0x556a8b4da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2408706556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cb650 msgr2=0x556a8b4da9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cb650 0x556a8b4da9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 msgr2=0x556a8b4d8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4d8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 -- 172.21.15.43:0/2408706556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8b36c9d0 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f24a0013690 tx=0x7f24a00136c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111111ddab13d5af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.782+0000 7f248b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a0013d30 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f24a00125f0 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24a0018070 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a0012810 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 10 client.15564 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a8b4e85a0 con 0x556a8b4cbf70 2024-04-25T20:51:37.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f24a0018070 con 0x556a8b4cbf70 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f24a0027b40 con 0x556a8b4cbf70 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 10 client.15564 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 20 client.15564 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b4eabe0 0x556a8b4ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 4 client.15564 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.783+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a8b42c580 con 0x556a8b4eabe0 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.784+0000 7f24abfff700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b4eabe0 0x556a8b4ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.784+0000 7f24abfff700 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b4eabe0 0x556a8b4ecfd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7725d2434b891479 server_cookie=c810eaf07d2058ba in_seq=0 out_seq=0 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.784+0000 7f248b7fe700 10 client.15564 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f248b7fe700 1 -- 172.21.15.43:0/2408706556 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556a8b42c580 con 0x556a8b4eabe0 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f248b7fe700 10 client.15564 handle_command_reply: tid=0 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 client.15564 shutdown 2024-04-25T20:51:37.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 msgr2=0x556a8b4d7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f24a0013690 tx=0x7f24a00136c0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 shutdown_connections 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b4eabe0 0x556a8b4ecfd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cb650 0x556a8b4da9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4d8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2408706556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cbf70 0x556a8b4d7ce0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 >> 172.21.15.43:0/2408706556 conn(0x556a8b3f8990 msgr2=0x556a8b4cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f248b7fe700 0 client.15564 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 shutdown_connections 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2408706556 wait complete. 2024-04-25T20:51:37.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.785+0000 7f24bcb89b80 20 client.15564 trim_cache size 0 max 16384 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 Processor -- start 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 -- start start 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1ab0f0 con 0x556a8b4cb650 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1acc30 con 0x556a8b4db280 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1ab7c0 con 0x556a8b4cbf70 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58452/0 (socket says 172.21.15.43:58452) 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 -- 172.21.15.43:0/2260984345 learned_addr learned my addr 172.21.15.43:0/2260984345 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24b089d700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 -- 172.21.15.43:0/2260984345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 msgr2=0x556a8b4d6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4d6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 -- 172.21.15.43:0/2260984345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 msgr2=0x556a8b4f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.805+0000 7f24abfff700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f24abfff700 1 -- 172.21.15.43:0/2260984345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8b4cd0e0 con 0x556a8b4cb650 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f24abfff700 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f249c006fd0 tx=0x7f249c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba568a1625b03a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f2491ffb700 1 -- 172.21.15.43:0/2260984345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c026150 con 0x556a8b4cb650 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f2491ffb700 1 -- 172.21.15.43:0/2260984345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f249c02a030 con 0x556a8b4cb650 2024-04-25T20:51:37.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f2491ffb700 1 -- 172.21.15.43:0/2260984345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0148d0 con 0x556a8b4cb650 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2260984345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 msgr2=0x556a8b4e6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.806+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f249c006fd0 tx=0x7f249c013000 comp rx=0 tx=0).stop 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2260984345 shutdown_connections 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4db280 0x556a8b4f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4cb650 0x556a8b4e6c10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/2260984345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2260984345 >> 172.21.15.43:0/2260984345 conn(0x556a8b3f8990 msgr2=0x556a8b4d64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2260984345 shutdown_connections 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- 172.21.15.43:0/2260984345 wait complete. 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- start start 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 Processor -- start 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1ac560 con 0x556a8b4db280 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1abe90 con 0x556a8b4cb650 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.807+0000 7f24bcb89b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac1a90b0 con 0x556a8b4cbf70 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24bcb89b80 10 client.0 _ll_register_callbacks cb 0x556a8b3b7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58460/0 (socket says 172.21.15.43:58460) 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 -- 172.21.15.43:0/4183339456 learned_addr learned my addr 172.21.15.43:0/4183339456 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24abfff700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24ab7fe700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 -- 172.21.15.43:0/4183339456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 msgr2=0x556a8b4e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4e3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 -- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 msgr2=0x556a8b4e3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4e3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 -- 172.21.15.43:0/4183339456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8b4de7b0 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24abfff700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24b089d700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f24a409d000 tx=0x7f24a40a1420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d502887ddf39ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f248b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4009bf0 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f24a40a1110 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249c02a030 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f24a4097be0 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24bcb89b80 10 client.15570 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.808+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a8b551880 con 0x556a8b4db280 2024-04-25T20:51:37.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f249c02a030 con 0x556a8b4db280 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f24a4011070 con 0x556a8b4db280 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 10 client.15570 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 20 client.15570 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b551f30 0x556a8b554350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 4 client.15570 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c49d1494", "release": true, "await": true}] 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c49d1494", "release": true, "await": true}) -- 0x556a8b426620 con 0x556a8b551f30 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.809+0000 7f24abfff700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b551f30 0x556a8b554350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.810+0000 7f24abfff700 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b551f30 0x556a8b554350 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9903ec94bd350a92 server_cookie=10de62ac2cc6dcac in_seq=0 out_seq=0 2024-04-25T20:51:37.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.810+0000 7f248b7fe700 10 client.15570 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.813+0000 7f248b7fe700 1 -- 172.21.15.43:0/4183339456 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x556a8b426620 con 0x556a8b551f30 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.813+0000 7f248b7fe700 10 client.15570 handle_command_reply: tid=0 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.813+0000 7f24bcb89b80 1 client.15570 shutdown 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 msgr2=0x556a8b4de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f24a409d000 tx=0x7f24a40a1420 comp rx=0 tx=0).stop 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 shutdown_connections 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556a8b551f30 0x556a8b554350 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a8b4db280 0x556a8b4de0e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556a8b4cb650 0x556a8b4e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 --2- 172.21.15.43:0/4183339456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a8b4cbf70 0x556a8b4e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 >> 172.21.15.43:0/4183339456 conn(0x556a8b3f8990 msgr2=0x556a8b4c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f248b7fe700 0 client.15570 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:37.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 shutdown_connections 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 1 -- 172.21.15.43:0/4183339456 wait complete. 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.814+0000 7f24bcb89b80 20 client.15570 trim_cache size 0 max 16384 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 28, 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "leader": 24470, 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "set_version": 4, 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "sets": { 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "c49d1494": { 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "version": 4, 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "age_ref": 0.0, 2024-04-25T20:51:37.817 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RELEASED", 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "timeout": 60.0, 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "expiration": 86.2, 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "members": { 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "file:/": { 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "excluded": false, 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RELEASED", 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:37.818 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 msgr2=0x7f24940a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 0x7f24940a6270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f249c0099d0 tx=0x7f249c008040 comp rx=0 tx=0).stop 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 msgr2=0x7f24ac19dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f24a400b070 tx=0x7f24a4007ac0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 shutdown_connections 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f24940a3db0 0x7f24940a6270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24ac101970 0x7f24ac199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24ac107920 0x7f24ac19dc20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 --2- 172.21.15.43:0/3784673647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24ac102330 0x7f24ac199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 >> 172.21.15.43:0/3784673647 conn(0x7f24ac0788f0 msgr2=0x7f24ac1056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 shutdown_connections 2024-04-25T20:51:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:37.815+0000 7f24b2300700 1 -- 172.21.15.43:0/3784673647 wait complete. 2024-04-25T20:51:37.820 INFO:tasks.workunit.client.0.smithi043.stderr:+ KERNEL=linux-4.0.5 2024-04-25T20:51:37.820 INFO:tasks.workunit.client.0.smithi043.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-04-25T20:51:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:38 smithi043 ceph-mon[29167]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:38 smithi195 ceph-mon[33250]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:38 smithi112 ceph-mon[32322]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:38.661 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c49d1494', seconds elapsed: 39.4 2024-04-25T20:51:38.661 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.2 2024-04-25T20:51:38.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:51:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:40.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:40 smithi043 ceph-mon[29167]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:40 smithi195 ceph-mon[33250]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:40 smithi112 ceph-mon[32322]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 -- 172.21.15.43:0/103083285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4103450 msgr2=0x7f62e410f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/103083285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4103450 0x7f62e410f8b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00b0a0 tx=0x7f62dc00b3b0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 -- 172.21.15.43:0/103083285 shutdown_connections 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/103083285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4103450 0x7f62e410f8b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/103083285 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 0x7f62e4108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/103083285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4102a90 0x7f62e4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 -- 172.21.15.43:0/103083285 >> 172.21.15.43:0/103083285 conn(0x7f62e4079ba0 msgr2=0x7f62e4079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 -- 172.21.15.43:0/103083285 shutdown_connections 2024-04-25T20:51:40.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.607+0000 7f62ebb0f700 1 -- 172.21.15.43:0/103083285 wait complete. 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 Processor -- start 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 -- start start 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 0x7f62e41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 0x7f62e419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4112da0 con 0x7f62e4102a90 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4112c20 con 0x7f62e4108a50 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62ebb0f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4112f20 con 0x7f62e4103450 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62e98ab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62e98ab700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58488/0 (socket says 172.21.15.43:58488) 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.608+0000 7f62e98ab700 1 -- 172.21.15.43:0/2714713099 learned_addr learned my addr 172.21.15.43:0/2714713099 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e90aa700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 0x7f62e41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:40.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62ea0ac700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 0x7f62e419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 -- 172.21.15.43:0/2714713099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 msgr2=0x7f62e41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 0x7f62e41997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 -- 172.21.15.43:0/2714713099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 msgr2=0x7f62e419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 0x7f62e419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 -- 172.21.15.43:0/2714713099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e419e280 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e90aa700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 0x7f62e41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62e98ab700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c920 tx=0x7f62e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0007b00 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e419e570 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62e0004d00 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0005620 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.609+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e41a5df0 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.610+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e4069730 con 0x7f62e4102a90 2024-04-25T20:51:40.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.611+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f62e0004750 con 0x7f62e4102a90 2024-04-25T20:51:40.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.612+0000 7f62d6ffd700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 0x7f62d00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:40.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.612+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f62e00d0880 con 0x7f62e4102a90 2024-04-25T20:51:40.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.612+0000 7f62e90aa700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 0x7f62d00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:40.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.612+0000 7f62e90aa700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 0x7f62d00a6270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62e407a280 tx=0x7f62d8008040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:40.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.616+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f62e0014030 con 0x7f62e4102a90 2024-04-25T20:51:40.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.870+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62e419a5d0 con 0x7f62e4102a90 2024-04-25T20:51:40.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.871+0000 7f62d6ffd700 1 -- 172.21.15.43:0/2714713099 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f62e009cf50 con 0x7f62e4102a90 2024-04-25T20:51:40.871 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:51:40.872 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:49:56.955674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24449,24448,24424,24430]},"id":1}]} 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 msgr2=0x7f62d00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 0x7f62d00a6270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62e407a280 tx=0x7f62d8008040 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 msgr2=0x7f62e4199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f62e000c920 tx=0x7f62e000cce0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 shutdown_connections 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f62d00a3db0 0x7f62d00a6270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62e4108a50 0x7f62e419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62e4102a90 0x7f62e4199270 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 --2- 172.21.15.43:0/2714713099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62e4103450 0x7f62e41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 >> 172.21.15.43:0/2714713099 conn(0x7f62e4079ba0 msgr2=0x7f62e4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:40.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 shutdown_connections 2024-04-25T20:51:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:40.873+0000 7f62ebb0f700 1 -- 172.21.15.43:0/2714713099 wait complete. 2024-04-25T20:51:40.875 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 28 2024-04-25T20:51:40.956 INFO:tasks.workunit.client.0.smithi043.stderr:+ mkdir untar_tar 2024-04-25T20:51:40.958 INFO:tasks.workunit.client.0.smithi043.stderr:+ cd untar_tar 2024-04-25T20:51:40.958 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-04-25T20:51:41.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ 2024-04-25T20:51:41.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/00-INDEX 2024-04-25T20:51:41.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/ 2024-04-25T20:51:41.231 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/README 2024-04-25T20:51:41.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-04-25T20:51:41.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-04-25T20:51:41.234 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-04-25T20:51:41.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-04-25T20:51:41.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-04-25T20:51:41.237 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-04-25T20:51:41.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-04-25T20:51:41.239 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-04-25T20:51:41.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-04-25T20:51:41.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-04-25T20:51:41.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-04-25T20:51:41.243 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-04-25T20:51:41.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-04-25T20:51:41.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-04-25T20:51:41.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-04-25T20:51:41.248 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-04-25T20:51:41.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-04-25T20:51:41.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-04-25T20:51:41.251 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-04-25T20:51:41.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-04-25T20:51:41.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-04-25T20:51:41.254 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-04-25T20:51:41.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-04-25T20:51:41.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-04-25T20:51:41.257 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-04-25T20:51:41.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-04-25T20:51:41.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-04-25T20:51:41.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-04-25T20:51:41.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-04-25T20:51:41.262 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-04-25T20:51:41.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-04-25T20:51:41.264 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-04-25T20:51:41.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-04-25T20:51:41.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-04-25T20:51:41.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-04-25T20:51:41.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-04-25T20:51:41.269 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-04-25T20:51:41.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-04-25T20:51:41.271 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-04-25T20:51:41.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-04-25T20:51:41.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-04-25T20:51:41.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-04-25T20:51:41.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-04-25T20:51:41.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-04-25T20:51:41.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-04-25T20:51:41.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-04-25T20:51:41.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-04-25T20:51:41.280 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-04-25T20:51:41.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-04-25T20:51:41.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-04-25T20:51:41.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-04-25T20:51:41.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-04-25T20:51:41.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-04-25T20:51:41.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-04-25T20:51:41.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-04-25T20:51:41.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-04-25T20:51:41.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-04-25T20:51:41.290 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-04-25T20:51:41.291 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-04-25T20:51:41.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-04-25T20:51:41.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-04-25T20:51:41.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-04-25T20:51:41.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:41 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2714713099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:41.295 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-04-25T20:51:41.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-04-25T20:51:41.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-04-25T20:51:41.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-04-25T20:51:41.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-04-25T20:51:41.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-04-25T20:51:41.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-04-25T20:51:41.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-04-25T20:51:41.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-04-25T20:51:41.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-04-25T20:51:41.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-04-25T20:51:41.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-04-25T20:51:41.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-04-25T20:51:41.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-04-25T20:51:41.309 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-04-25T20:51:41.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-04-25T20:51:41.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-04-25T20:51:41.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-04-25T20:51:41.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-04-25T20:51:41.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-04-25T20:51:41.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-04-25T20:51:41.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-04-25T20:51:41.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-04-25T20:51:41.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-04-25T20:51:41.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-04-25T20:51:41.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-04-25T20:51:41.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-04-25T20:51:41.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-04-25T20:51:41.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-04-25T20:51:41.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-04-25T20:51:41.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-04-25T20:51:41.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-04-25T20:51:41.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-04-25T20:51:41.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-04-25T20:51:41.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-04-25T20:51:41.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-04-25T20:51:41.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-04-25T20:51:41.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-04-25T20:51:41.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-04-25T20:51:41.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-04-25T20:51:41.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-04-25T20:51:41.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-04-25T20:51:41.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-04-25T20:51:41.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-04-25T20:51:41.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-04-25T20:51:41.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-04-25T20:51:41.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:41 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2714713099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:41.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-04-25T20:51:41.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:41 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2714713099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:51:41.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-04-25T20:51:41.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-04-25T20:51:41.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-04-25T20:51:41.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-04-25T20:51:41.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-04-25T20:51:41.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-04-25T20:51:41.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-04-25T20:51:41.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-04-25T20:51:41.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-04-25T20:51:41.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-04-25T20:51:41.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-04-25T20:51:41.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-04-25T20:51:41.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-04-25T20:51:41.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-04-25T20:51:41.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-04-25T20:51:41.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-04-25T20:51:41.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-04-25T20:51:41.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-04-25T20:51:41.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-04-25T20:51:41.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-04-25T20:51:41.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-04-25T20:51:41.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-04-25T20:51:41.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-04-25T20:51:41.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-04-25T20:51:41.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-04-25T20:51:41.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-04-25T20:51:41.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-04-25T20:51:41.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-04-25T20:51:41.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-04-25T20:51:41.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-04-25T20:51:41.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-04-25T20:51:41.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-04-25T20:51:41.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-04-25T20:51:41.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-04-25T20:51:41.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-04-25T20:51:41.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-04-25T20:51:41.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-04-25T20:51:41.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-04-25T20:51:41.399 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-04-25T20:51:41.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-04-25T20:51:41.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-04-25T20:51:41.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-04-25T20:51:41.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-04-25T20:51:41.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-04-25T20:51:41.407 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-04-25T20:51:41.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-04-25T20:51:41.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-04-25T20:51:41.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-04-25T20:51:41.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-04-25T20:51:41.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-04-25T20:51:41.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-04-25T20:51:41.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-04-25T20:51:41.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-04-25T20:51:41.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-04-25T20:51:41.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-04-25T20:51:41.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-04-25T20:51:41.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-04-25T20:51:41.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-04-25T20:51:41.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-04-25T20:51:41.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-04-25T20:51:41.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-04-25T20:51:41.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-04-25T20:51:41.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-04-25T20:51:41.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-04-25T20:51:41.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-04-25T20:51:41.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-04-25T20:51:41.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-04-25T20:51:41.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-04-25T20:51:41.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-04-25T20:51:41.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-04-25T20:51:41.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-04-25T20:51:41.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-04-25T20:51:41.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-04-25T20:51:41.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-04-25T20:51:41.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-04-25T20:51:41.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-04-25T20:51:41.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-04-25T20:51:41.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-04-25T20:51:41.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-04-25T20:51:41.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-04-25T20:51:41.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-04-25T20:51:41.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-04-25T20:51:41.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-04-25T20:51:41.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-04-25T20:51:41.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-04-25T20:51:41.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-04-25T20:51:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:42 smithi043 ceph-mon[29167]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-04-25T20:51:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:42 smithi195 ceph-mon[33250]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-04-25T20:51:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:42 smithi112 ceph-mon[32322]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.8 KiB/s wr, 15 op/s 2024-04-25T20:51:42.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-04-25T20:51:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-04-25T20:51:42.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-04-25T20:51:42.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-04-25T20:51:42.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-04-25T20:51:42.476 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-04-25T20:51:42.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-04-25T20:51:42.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-04-25T20:51:42.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-04-25T20:51:42.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-04-25T20:51:42.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-04-25T20:51:42.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-04-25T20:51:42.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-04-25T20:51:42.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-04-25T20:51:42.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-04-25T20:51:42.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-04-25T20:51:42.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-04-25T20:51:42.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-04-25T20:51:42.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-04-25T20:51:42.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-04-25T20:51:42.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-04-25T20:51:42.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-04-25T20:51:42.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-04-25T20:51:42.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-04-25T20:51:42.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-04-25T20:51:42.507 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-04-25T20:51:42.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-04-25T20:51:42.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-04-25T20:51:42.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-04-25T20:51:42.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-04-25T20:51:42.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-04-25T20:51:42.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-04-25T20:51:42.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-04-25T20:51:42.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-04-25T20:51:42.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-04-25T20:51:42.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-04-25T20:51:42.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-04-25T20:51:42.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-04-25T20:51:42.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-04-25T20:51:42.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-04-25T20:51:42.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-04-25T20:51:42.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-04-25T20:51:42.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-04-25T20:51:42.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-04-25T20:51:42.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-04-25T20:51:42.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-04-25T20:51:42.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-04-25T20:51:42.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-04-25T20:51:42.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-04-25T20:51:42.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-04-25T20:51:42.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-04-25T20:51:42.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-04-25T20:51:42.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-04-25T20:51:42.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-04-25T20:51:42.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-04-25T20:51:42.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-04-25T20:51:42.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-04-25T20:51:42.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-04-25T20:51:42.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-04-25T20:51:42.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-04-25T20:51:42.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-04-25T20:51:42.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-04-25T20:51:42.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-04-25T20:51:42.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Changes 2024-04-25T20:51:42.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-04-25T20:51:42.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/CodingStyle 2024-04-25T20:51:42.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-04-25T20:51:42.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-04-25T20:51:42.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-04-25T20:51:42.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-04-25T20:51:42.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/ 2024-04-25T20:51:42.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-04-25T20:51:42.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-04-25T20:51:42.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-04-25T20:51:42.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-04-25T20:51:42.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-04-25T20:51:42.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-04-25T20:51:42.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-04-25T20:51:42.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-04-25T20:51:42.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-04-25T20:51:42.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-04-25T20:51:42.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-04-25T20:51:42.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-04-25T20:51:42.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-04-25T20:51:42.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-04-25T20:51:42.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-04-25T20:51:42.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-04-25T20:51:42.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-04-25T20:51:42.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-04-25T20:51:42.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-04-25T20:51:42.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-04-25T20:51:42.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-04-25T20:51:42.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-04-25T20:51:42.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-04-25T20:51:42.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-04-25T20:51:42.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-04-25T20:51:42.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-04-25T20:51:42.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-04-25T20:51:42.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-04-25T20:51:42.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-04-25T20:51:42.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-04-25T20:51:42.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-04-25T20:51:42.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-04-25T20:51:42.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-04-25T20:51:42.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-04-25T20:51:42.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-04-25T20:51:42.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-04-25T20:51:42.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-04-25T20:51:42.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-04-25T20:51:42.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-04-25T20:51:42.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-04-25T20:51:42.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-04-25T20:51:42.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-04-25T20:51:42.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-04-25T20:51:42.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-04-25T20:51:42.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-04-25T20:51:42.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-04-25T20:51:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-04-25T20:51:42.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-04-25T20:51:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-04-25T20:51:42.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-04-25T20:51:42.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-04-25T20:51:42.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-04-25T20:51:42.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-04-25T20:51:42.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-04-25T20:51:42.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-04-25T20:51:42.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-04-25T20:51:42.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-04-25T20:51:42.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-04-25T20:51:42.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-04-25T20:51:42.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-04-25T20:51:42.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-04-25T20:51:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-04-25T20:51:42.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-04-25T20:51:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-04-25T20:51:42.621 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-04-25T20:51:42.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-04-25T20:51:42.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-04-25T20:51:42.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-04-25T20:51:42.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-04-25T20:51:42.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-04-25T20:51:42.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-04-25T20:51:42.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-04-25T20:51:42.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-04-25T20:51:42.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-04-25T20:51:42.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-04-25T20:51:42.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-04-25T20:51:42.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-04-25T20:51:42.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-04-25T20:51:42.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-04-25T20:51:42.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-04-25T20:51:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-04-25T20:51:42.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-04-25T20:51:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-04-25T20:51:42.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-04-25T20:51:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-04-25T20:51:42.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-04-25T20:51:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-04-25T20:51:42.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-04-25T20:51:42.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-04-25T20:51:42.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-04-25T20:51:42.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-04-25T20:51:42.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-04-25T20:51:42.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-04-25T20:51:42.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-04-25T20:51:42.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-04-25T20:51:42.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-04-25T20:51:42.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-04-25T20:51:42.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-04-25T20:51:42.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-04-25T20:51:42.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-04-25T20:51:42.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-04-25T20:51:42.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-04-25T20:51:42.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-04-25T20:51:42.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-04-25T20:51:42.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-04-25T20:51:42.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-04-25T20:51:42.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-04-25T20:51:42.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-04-25T20:51:42.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-04-25T20:51:42.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-04-25T20:51:42.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-04-25T20:51:42.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-04-25T20:51:42.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-04-25T20:51:42.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-04-25T20:51:42.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-04-25T20:51:42.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-04-25T20:51:42.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-04-25T20:51:42.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-04-25T20:51:42.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-04-25T20:51:42.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-04-25T20:51:42.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-04-25T20:51:42.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-04-25T20:51:42.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-04-25T20:51:42.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-04-25T20:51:42.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-04-25T20:51:42.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-04-25T20:51:42.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-04-25T20:51:42.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-04-25T20:51:42.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-04-25T20:51:42.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-04-25T20:51:42.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-04-25T20:51:42.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-04-25T20:51:42.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-04-25T20:51:42.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-04-25T20:51:42.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-04-25T20:51:42.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-04-25T20:51:42.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-04-25T20:51:42.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-04-25T20:51:42.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-04-25T20:51:42.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-04-25T20:51:42.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-04-25T20:51:42.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-04-25T20:51:42.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-04-25T20:51:42.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-04-25T20:51:42.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-04-25T20:51:42.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-04-25T20:51:42.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-04-25T20:51:42.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-04-25T20:51:42.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-04-25T20:51:42.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-04-25T20:51:42.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-04-25T20:51:42.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-04-25T20:51:42.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-04-25T20:51:42.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-04-25T20:51:42.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-04-25T20:51:42.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-04-25T20:51:42.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-04-25T20:51:42.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-04-25T20:51:42.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-04-25T20:51:42.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-04-25T20:51:42.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-04-25T20:51:42.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-04-25T20:51:42.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-04-25T20:51:42.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-04-25T20:51:42.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-04-25T20:51:42.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-04-25T20:51:42.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-04-25T20:51:42.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-04-25T20:51:42.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-04-25T20:51:42.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-04-25T20:51:42.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-04-25T20:51:42.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-04-25T20:51:42.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-04-25T20:51:42.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-04-25T20:51:42.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-04-25T20:51:42.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-04-25T20:51:42.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-04-25T20:51:42.732 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-04-25T20:51:42.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-04-25T20:51:42.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-04-25T20:51:42.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-04-25T20:51:42.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-04-25T20:51:42.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-04-25T20:51:42.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-04-25T20:51:42.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-04-25T20:51:42.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-04-25T20:51:42.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-04-25T20:51:42.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-04-25T20:51:42.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-04-25T20:51:42.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-04-25T20:51:42.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-04-25T20:51:42.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-04-25T20:51:42.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-04-25T20:51:42.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-04-25T20:51:42.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-04-25T20:51:42.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-04-25T20:51:42.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-04-25T20:51:42.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-04-25T20:51:43.306 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24470 quiesce db / --timeout 60 --expiration 86.2 --await-for 42.0' 2024-04-25T20:51:43.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24470 quiesce db / --timeout 60 --expiration 86.2 --await-for 42.0 2024-04-25T20:51:43.561 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:51:43.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-04-25T20:51:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-04-25T20:51:43.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-04-25T20:51:43.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-04-25T20:51:43.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-04-25T20:51:43.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-04-25T20:51:43.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-04-25T20:51:43.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-04-25T20:51:43.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-04-25T20:51:43.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-04-25T20:51:43.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-04-25T20:51:43.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-04-25T20:51:43.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-04-25T20:51:43.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-04-25T20:51:43.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-04-25T20:51:43.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-04-25T20:51:43.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-04-25T20:51:43.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-04-25T20:51:43.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-04-25T20:51:43.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-04-25T20:51:43.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-04-25T20:51:43.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-04-25T20:51:43.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-04-25T20:51:43.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-04-25T20:51:43.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-04-25T20:51:43.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-04-25T20:51:43.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-04-25T20:51:43.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-04-25T20:51:43.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-04-25T20:51:43.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-04-25T20:51:43.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-04-25T20:51:43.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-04-25T20:51:43.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-04-25T20:51:43.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-04-25T20:51:43.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/ 2024-04-25T20:51:43.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-04-25T20:51:43.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-04-25T20:51:43.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-04-25T20:51:43.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-04-25T20:51:43.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-04-25T20:51:43.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-04-25T20:51:43.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-04-25T20:51:43.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-04-25T20:51:43.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-04-25T20:51:43.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/EDID/hex 2024-04-25T20:51:43.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/HOWTO 2024-04-25T20:51:43.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-04-25T20:51:43.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-04-25T20:51:43.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-04-25T20:51:43.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-04-25T20:51:43.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-04-25T20:51:43.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/Makefile 2024-04-25T20:51:43.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-04-25T20:51:43.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/ 2024-04-25T20:51:43.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-04-25T20:51:43.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-04-25T20:51:43.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-04-25T20:51:43.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-04-25T20:51:43.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-04-25T20:51:43.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-04-25T20:51:43.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-04-25T20:51:43.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/ 2024-04-25T20:51:43.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-04-25T20:51:43.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-04-25T20:51:43.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-04-25T20:51:43.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-04-25T20:51:43.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-04-25T20:51:43.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-04-25T20:51:43.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-04-25T20:51:43.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-04-25T20:51:43.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-04-25T20:51:43.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-04-25T20:51:43.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-04-25T20:51:43.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-04-25T20:51:43.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-04-25T20:51:43.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-04-25T20:51:43.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-04-25T20:51:43.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-04-25T20:51:43.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-04-25T20:51:43.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-04-25T20:51:43.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SAK.txt 2024-04-25T20:51:43.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SM501.txt 2024-04-25T20:51:43.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-04-25T20:51:43.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-04-25T20:51:43.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-04-25T20:51:43.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-04-25T20:51:43.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-04-25T20:51:43.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/ 2024-04-25T20:51:43.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-04-25T20:51:43.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-04-25T20:51:43.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-04-25T20:51:43.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-04-25T20:51:43.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-04-25T20:51:43.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-04-25T20:51:43.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-04-25T20:51:43.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/ 2024-04-25T20:51:43.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-04-25T20:51:43.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-04-25T20:51:43.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-04-25T20:51:43.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-04-25T20:51:43.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-04-25T20:51:43.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-04-25T20:51:43.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-04-25T20:51:43.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-04-25T20:51:43.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-04-25T20:51:43.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-04-25T20:51:43.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-04-25T20:51:43.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-04-25T20:51:43.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-04-25T20:51:43.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/ 2024-04-25T20:51:43.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-04-25T20:51:43.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-04-25T20:51:43.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-04-25T20:51:43.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-04-25T20:51:43.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-04-25T20:51:43.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-04-25T20:51:43.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-04-25T20:51:43.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/ 2024-04-25T20:51:43.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-04-25T20:51:43.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-04-25T20:51:43.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-04-25T20:51:43.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Booting 2024-04-25T20:51:43.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-04-25T20:51:43.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-04-25T20:51:43.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-04-25T20:51:43.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-04-25T20:51:43.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-04-25T20:51:43.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-04-25T20:51:43.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-04-25T20:51:43.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-04-25T20:51:43.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-04-25T20:51:43.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-04-25T20:51:43.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Porting 2024-04-25T20:51:43.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/README 2024-04-25T20:51:43.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-04-25T20:51:43.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-04-25T20:51:43.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-04-25T20:51:43.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-04-25T20:51:43.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-04-25T20:51:43.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-04-25T20:51:43.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-04-25T20:51:43.732 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-04-25T20:51:43.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-04-25T20:51:43.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-04-25T20:51:43.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-04-25T20:51:43.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-04-25T20:51:43.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-04-25T20:51:43.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-04-25T20:51:43.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-04-25T20:51:43.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-04-25T20:51:43.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-04-25T20:51:43.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-04-25T20:51:43.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-04-25T20:51:43.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-04-25T20:51:43.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-04-25T20:51:43.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-04-25T20:51:43.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-04-25T20:51:43.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-04-25T20:51:43.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-04-25T20:51:43.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-04-25T20:51:43.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-04-25T20:51:43.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-04-25T20:51:43.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-04-25T20:51:43.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-04-25T20:51:43.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-04-25T20:51:43.755 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-04-25T20:51:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-04-25T20:51:43.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-04-25T20:51:43.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-04-25T20:51:43.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-04-25T20:51:43.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-04-25T20:51:43.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-04-25T20:51:43.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-04-25T20:51:43.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-04-25T20:51:43.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-04-25T20:51:43.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-04-25T20:51:43.765 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-04-25T20:51:43.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/Setup 2024-04-25T20:51:43.767 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-04-25T20:51:43.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-04-25T20:51:43.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-04-25T20:51:43.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-04-25T20:51:43.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-04-25T20:51:43.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-04-25T20:51:43.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-04-25T20:51:43.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-04-25T20:51:43.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-04-25T20:51:43.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-04-25T20:51:43.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-04-25T20:51:43.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/ 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-04-25T20:51:43.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-04-25T20:51:43.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-04-25T20:51:43.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-04-25T20:51:43.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-04-25T20:51:43.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-04-25T20:51:43.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-04-25T20:51:43.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-04-25T20:51:43.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/backlight/ 2024-04-25T20:51:43.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-04-25T20:51:43.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-04-25T20:51:43.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-04-25T20:51:43.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bcache.txt 2024-04-25T20:51:43.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-04-25T20:51:43.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/ 2024-04-25T20:51:43.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-04-25T20:51:43.817 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-04-25T20:51:43.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-04-25T20:51:43.819 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-04-25T20:51:43.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-04-25T20:51:43.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/ 2024-04-25T20:51:43.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-04-25T20:51:43.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-04-25T20:51:43.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-04-25T20:51:43.825 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-04-25T20:51:43.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-04-25T20:51:43.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-04-25T20:51:43.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-04-25T20:51:43.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-04-25T20:51:43.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-04-25T20:51:43.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-04-25T20:51:43.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-04-25T20:51:43.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/request.txt 2024-04-25T20:51:43.833 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-04-25T20:51:43.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-04-25T20:51:43.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-04-25T20:51:43.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/ 2024-04-25T20:51:43.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-04-25T20:51:43.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-04-25T20:51:43.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-04-25T20:51:43.840 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-04-25T20:51:43.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-04-25T20:51:43.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-04-25T20:51:43.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-04-25T20:51:43.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-04-25T20:51:43.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-04-25T20:51:43.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-04-25T20:51:43.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-04-25T20:51:43.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-04-25T20:51:43.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-04-25T20:51:43.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-04-25T20:51:43.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-04-25T20:51:43.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-04-25T20:51:43.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-04-25T20:51:43.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-04-25T20:51:43.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-04-25T20:51:43.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-04-25T20:51:43.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-04-25T20:51:43.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-04-25T20:51:43.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-04-25T20:51:43.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-04-25T20:51:43.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-04-25T20:51:43.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-04-25T20:51:43.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/ 2024-04-25T20:51:43.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-04-25T20:51:43.864 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-04-25T20:51:43.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-04-25T20:51:43.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-04-25T20:51:43.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-04-25T20:51:43.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/ 2024-04-25T20:51:43.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-04-25T20:51:43.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-04-25T20:51:43.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-04-25T20:51:43.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-04-25T20:51:43.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-04-25T20:51:43.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-04-25T20:51:43.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-04-25T20:51:43.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-04-25T20:51:43.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-04-25T20:51:43.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-04-25T20:51:43.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-04-25T20:51:43.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-04-25T20:51:43.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-04-25T20:51:43.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-04-25T20:51:43.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/clk.txt 2024-04-25T20:51:43.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-04-25T20:51:43.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/ 2024-04-25T20:51:43.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-04-25T20:51:43.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-04-25T20:51:43.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-04-25T20:51:43.889 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-04-25T20:51:43.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-04-25T20:51:43.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/console/ 2024-04-25T20:51:43.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/console/console.txt 2024-04-25T20:51:43.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-04-25T20:51:43.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-04-25T20:51:43.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-04-25T20:51:43.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-04-25T20:51:43.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-04-25T20:51:43.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-04-25T20:51:43.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-04-25T20:51:43.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-04-25T20:51:43.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-04-25T20:51:43.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-04-25T20:51:43.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-04-25T20:51:43.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-04-25T20:51:43.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-04-25T20:51:43.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-04-25T20:51:43.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-04-25T20:51:43.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-04-25T20:51:43.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-04-25T20:51:43.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-04-25T20:51:43.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-04-25T20:51:43.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-04-25T20:51:43.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crc32.txt 2024-04-25T20:51:43.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cris/ 2024-04-25T20:51:43.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/cris/README 2024-04-25T20:51:43.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/ 2024-04-25T20:51:43.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-04-25T20:51:43.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-04-25T20:51:43.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-04-25T20:51:43.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-04-25T20:51:43.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-04-25T20:51:43.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-04-25T20:51:43.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-04-25T20:51:43.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-04-25T20:51:43.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-04-25T20:51:43.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/ 2024-04-25T20:51:43.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-04-25T20:51:43.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-04-25T20:51:43.927 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-04-25T20:51:43.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-04-25T20:51:43.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-04-25T20:51:43.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-04-25T20:51:43.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-04-25T20:51:43.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-04-25T20:51:43.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-04-25T20:51:43.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-04-25T20:51:43.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-04-25T20:51:43.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-04-25T20:51:43.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-04-25T20:51:43.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-04-25T20:51:43.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-04-25T20:51:43.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-04-25T20:51:43.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-04-25T20:51:43.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-04-25T20:51:43.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-04-25T20:51:43.943 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-04-25T20:51:43.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-04-25T20:51:43.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-04-25T20:51:43.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-04-25T20:51:43.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-04-25T20:51:43.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-04-25T20:51:43.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-04-25T20:51:43.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-04-25T20:51:43.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-04-25T20:51:43.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-04-25T20:51:43.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-04-25T20:51:43.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-04-25T20:51:43.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devices.txt 2024-04-25T20:51:43.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/ 2024-04-25T20:51:43.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-04-25T20:51:43.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-04-25T20:51:43.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-04-25T20:51:43.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-04-25T20:51:43.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-04-25T20:51:43.962 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-04-25T20:51:43.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-04-25T20:51:43.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-04-25T20:51:43.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-04-25T20:51:43.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-04-25T20:51:43.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-04-25T20:51:43.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-04-25T20:51:43.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-04-25T20:51:43.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-04-25T20:51:43.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-04-25T20:51:43.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-04-25T20:51:43.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-04-25T20:51:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-04-25T20:51:43.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-04-25T20:51:43.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-04-25T20:51:43.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-04-25T20:51:43.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-04-25T20:51:43.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-04-25T20:51:43.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-04-25T20:51:43.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-04-25T20:51:43.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-04-25T20:51:43.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-04-25T20:51:43.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-04-25T20:51:43.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-04-25T20:51:43.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-04-25T20:51:43.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-04-25T20:51:43.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-04-25T20:51:43.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-04-25T20:51:43.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-04-25T20:51:43.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-04-25T20:51:43.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-04-25T20:51:43.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-04-25T20:51:43.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-04-25T20:51:43.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-04-25T20:51:43.993 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-04-25T20:51:43.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-04-25T20:51:43.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-04-25T20:51:43.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-04-25T20:51:43.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-04-25T20:51:43.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-04-25T20:51:43.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-04-25T20:51:43.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-04-25T20:51:44.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-04-25T20:51:44.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-04-25T20:51:44.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-04-25T20:51:44.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-04-25T20:51:44.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-04-25T20:51:44.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-04-25T20:51:44.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-04-25T20:51:44.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-04-25T20:51:44.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-04-25T20:51:44.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-04-25T20:51:44.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-04-25T20:51:44.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-04-25T20:51:44.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-04-25T20:51:44.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-04-25T20:51:44.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-04-25T20:51:44.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-04-25T20:51:44.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-04-25T20:51:44.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-04-25T20:51:44.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-04-25T20:51:44.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-04-25T20:51:44.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-04-25T20:51:44.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-04-25T20:51:44.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-04-25T20:51:44.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-04-25T20:51:44.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-04-25T20:51:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-04-25T20:51:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-04-25T20:51:44.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-04-25T20:51:44.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-04-25T20:51:44.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-04-25T20:51:44.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-04-25T20:51:44.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-04-25T20:51:44.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-04-25T20:51:44.032 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-04-25T20:51:44.033 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-04-25T20:51:44.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-04-25T20:51:44.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-04-25T20:51:44.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-04-25T20:51:44.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-04-25T20:51:44.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-04-25T20:51:44.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-04-25T20:51:44.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-04-25T20:51:44.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-04-25T20:51:44.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-04-25T20:51:44.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-04-25T20:51:44.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-04-25T20:51:44.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-04-25T20:51:44.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-04-25T20:51:44.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-04-25T20:51:44.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-04-25T20:51:44.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-04-25T20:51:44.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-04-25T20:51:44.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-04-25T20:51:44.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-04-25T20:51:44.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-04-25T20:51:44.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-04-25T20:51:44.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-04-25T20:51:44.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-04-25T20:51:44.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-04-25T20:51:44.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-04-25T20:51:44.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-04-25T20:51:44.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-04-25T20:51:44.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-04-25T20:51:44.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-04-25T20:51:44.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-04-25T20:51:44.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-04-25T20:51:44.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-04-25T20:51:44.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-04-25T20:51:44.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-04-25T20:51:44.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-04-25T20:51:44.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-04-25T20:51:44.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-04-25T20:51:44.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-04-25T20:51:44.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-04-25T20:51:44.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-04-25T20:51:44.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-04-25T20:51:44.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-04-25T20:51:44.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-04-25T20:51:44.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-04-25T20:51:44.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-04-25T20:51:44.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-04-25T20:51:44.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-04-25T20:51:44.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-04-25T20:51:44.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-04-25T20:51:44.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-04-25T20:51:44.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-04-25T20:51:44.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-04-25T20:51:44.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-04-25T20:51:44.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-04-25T20:51:44.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-04-25T20:51:44.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-04-25T20:51:44.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-04-25T20:51:44.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-04-25T20:51:44.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-04-25T20:51:44.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-04-25T20:51:44.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-04-25T20:51:44.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-04-25T20:51:44.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-04-25T20:51:44.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-04-25T20:51:44.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-04-25T20:51:44.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-04-25T20:51:44.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-04-25T20:51:44.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-04-25T20:51:44.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-04-25T20:51:44.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-04-25T20:51:44.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-04-25T20:51:44.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-04-25T20:51:44.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-04-25T20:51:44.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-04-25T20:51:44.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-04-25T20:51:44.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-04-25T20:51:44.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:44 smithi043 ceph-mon[29167]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-04-25T20:51:44.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-04-25T20:51:44.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-04-25T20:51:44.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-04-25T20:51:44.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-04-25T20:51:44.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-04-25T20:51:44.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-04-25T20:51:44.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-04-25T20:51:44.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-04-25T20:51:44.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-04-25T20:51:44.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-04-25T20:51:44.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-04-25T20:51:44.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-04-25T20:51:44.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-04-25T20:51:44.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-04-25T20:51:44.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-04-25T20:51:44.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-04-25T20:51:44.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-04-25T20:51:44.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-04-25T20:51:44.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-04-25T20:51:44.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-04-25T20:51:44.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-04-25T20:51:44.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-04-25T20:51:44.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-04-25T20:51:44.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-04-25T20:51:44.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-04-25T20:51:44.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-04-25T20:51:44.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-04-25T20:51:44.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-04-25T20:51:44.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-04-25T20:51:44.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-04-25T20:51:44.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-04-25T20:51:44.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-04-25T20:51:44.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-04-25T20:51:44.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-04-25T20:51:44.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:44 smithi195 ceph-mon[33250]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-04-25T20:51:44.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:44 smithi112 ceph-mon[32322]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-04-25T20:51:44.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-04-25T20:51:44.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-04-25T20:51:44.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-04-25T20:51:44.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-04-25T20:51:44.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-04-25T20:51:44.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-04-25T20:51:44.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-04-25T20:51:44.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-04-25T20:51:44.351 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-04-25T20:51:44.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-04-25T20:51:44.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-04-25T20:51:44.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-04-25T20:51:44.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-04-25T20:51:44.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-04-25T20:51:44.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-04-25T20:51:44.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-04-25T20:51:44.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-04-25T20:51:44.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-04-25T20:51:44.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-04-25T20:51:44.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-04-25T20:51:44.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-04-25T20:51:44.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-04-25T20:51:44.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-04-25T20:51:44.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-04-25T20:51:44.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-04-25T20:51:44.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-04-25T20:51:44.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-04-25T20:51:44.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-04-25T20:51:44.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-04-25T20:51:44.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-04-25T20:51:44.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-04-25T20:51:44.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-04-25T20:51:44.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-04-25T20:51:44.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-04-25T20:51:44.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-04-25T20:51:44.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-04-25T20:51:44.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-04-25T20:51:44.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-04-25T20:51:44.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-04-25T20:51:44.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-04-25T20:51:44.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-04-25T20:51:44.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-04-25T20:51:44.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-04-25T20:51:44.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-04-25T20:51:44.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-04-25T20:51:44.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-04-25T20:51:44.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-04-25T20:51:44.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-04-25T20:51:44.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-04-25T20:51:44.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-04-25T20:51:44.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-04-25T20:51:44.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-04-25T20:51:44.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-04-25T20:51:44.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-04-25T20:51:44.399 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-04-25T20:51:44.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-04-25T20:51:44.401 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-04-25T20:51:44.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-04-25T20:51:44.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-04-25T20:51:44.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-04-25T20:51:44.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-04-25T20:51:44.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-04-25T20:51:44.407 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-04-25T20:51:44.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-04-25T20:51:44.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-04-25T20:51:44.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-04-25T20:51:44.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-04-25T20:51:44.412 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-04-25T20:51:44.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-04-25T20:51:44.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-04-25T20:51:44.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-04-25T20:51:44.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-04-25T20:51:44.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-04-25T20:51:44.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-04-25T20:51:44.418 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-04-25T20:51:44.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-04-25T20:51:44.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-04-25T20:51:44.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-04-25T20:51:44.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-04-25T20:51:44.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-04-25T20:51:44.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-04-25T20:51:44.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-04-25T20:51:44.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-04-25T20:51:44.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-04-25T20:51:44.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-04-25T20:51:44.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-04-25T20:51:44.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-04-25T20:51:44.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-04-25T20:51:44.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-04-25T20:51:44.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-04-25T20:51:44.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-04-25T20:51:44.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-04-25T20:51:44.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-04-25T20:51:44.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-04-25T20:51:44.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-04-25T20:51:44.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-04-25T20:51:44.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-04-25T20:51:44.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-04-25T20:51:44.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-04-25T20:51:44.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-04-25T20:51:44.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-04-25T20:51:44.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-04-25T20:51:44.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-04-25T20:51:44.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-04-25T20:51:44.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-04-25T20:51:44.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-04-25T20:51:44.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-04-25T20:51:44.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-04-25T20:51:44.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-04-25T20:51:44.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-04-25T20:51:44.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-04-25T20:51:44.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-04-25T20:51:44.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-04-25T20:51:44.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-04-25T20:51:44.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-04-25T20:51:44.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-04-25T20:51:44.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-04-25T20:51:44.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-04-25T20:51:44.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-04-25T20:51:44.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-04-25T20:51:44.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-04-25T20:51:44.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-04-25T20:51:44.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-04-25T20:51:44.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-04-25T20:51:44.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-04-25T20:51:44.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-04-25T20:51:44.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-04-25T20:51:44.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-04-25T20:51:44.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-04-25T20:51:44.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-04-25T20:51:44.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-04-25T20:51:44.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-04-25T20:51:44.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-04-25T20:51:44.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-04-25T20:51:44.476 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-04-25T20:51:44.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-04-25T20:51:44.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-04-25T20:51:44.479 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-04-25T20:51:44.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-04-25T20:51:44.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-04-25T20:51:44.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-04-25T20:51:44.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-04-25T20:51:44.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-04-25T20:51:44.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-04-25T20:51:44.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-04-25T20:51:44.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-04-25T20:51:44.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-04-25T20:51:44.489 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-04-25T20:51:44.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-04-25T20:51:44.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-04-25T20:51:44.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-04-25T20:51:44.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-04-25T20:51:44.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-04-25T20:51:44.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-04-25T20:51:44.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-04-25T20:51:44.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-04-25T20:51:44.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-04-25T20:51:44.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-04-25T20:51:44.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-04-25T20:51:44.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-04-25T20:51:44.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-04-25T20:51:44.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-04-25T20:51:44.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-04-25T20:51:44.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-04-25T20:51:44.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-04-25T20:51:44.507 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-04-25T20:51:44.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-04-25T20:51:44.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-04-25T20:51:44.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-04-25T20:51:44.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-04-25T20:51:44.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-04-25T20:51:44.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-04-25T20:51:44.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-04-25T20:51:44.515 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-04-25T20:51:44.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-04-25T20:51:44.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-04-25T20:51:44.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-04-25T20:51:44.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-04-25T20:51:44.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-04-25T20:51:44.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-04-25T20:51:44.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-04-25T20:51:44.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-04-25T20:51:44.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-04-25T20:51:44.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-04-25T20:51:44.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-04-25T20:51:44.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-04-25T20:51:44.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-04-25T20:51:44.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-04-25T20:51:44.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-04-25T20:51:44.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-04-25T20:51:44.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-04-25T20:51:44.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-04-25T20:51:44.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-04-25T20:51:44.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-04-25T20:51:44.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-04-25T20:51:44.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-04-25T20:51:44.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-04-25T20:51:44.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-04-25T20:51:44.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-04-25T20:51:44.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-04-25T20:51:44.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-04-25T20:51:44.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-04-25T20:51:44.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-04-25T20:51:44.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-04-25T20:51:44.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-04-25T20:51:44.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-04-25T20:51:44.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-04-25T20:51:44.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-04-25T20:51:44.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-04-25T20:51:44.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-04-25T20:51:44.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-04-25T20:51:44.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-04-25T20:51:44.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-04-25T20:51:44.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-04-25T20:51:44.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-04-25T20:51:44.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-04-25T20:51:44.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-04-25T20:51:44.556 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-04-25T20:51:44.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-04-25T20:51:44.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-04-25T20:51:44.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-04-25T20:51:44.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-04-25T20:51:44.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-04-25T20:51:44.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-04-25T20:51:44.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-04-25T20:51:44.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-04-25T20:51:44.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-04-25T20:51:44.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-04-25T20:51:44.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-04-25T20:51:44.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-04-25T20:51:44.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-04-25T20:51:44.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-04-25T20:51:44.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-04-25T20:51:44.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-04-25T20:51:44.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-04-25T20:51:44.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-04-25T20:51:44.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-04-25T20:51:44.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-04-25T20:51:44.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-04-25T20:51:44.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-04-25T20:51:44.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-04-25T20:51:44.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-04-25T20:51:44.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-04-25T20:51:44.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-04-25T20:51:44.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-04-25T20:51:44.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-04-25T20:51:44.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-04-25T20:51:44.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-04-25T20:51:44.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-04-25T20:51:44.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-04-25T20:51:44.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-04-25T20:51:44.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-04-25T20:51:44.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-04-25T20:51:44.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-04-25T20:51:44.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-04-25T20:51:44.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-04-25T20:51:44.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-04-25T20:51:44.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-04-25T20:51:44.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-04-25T20:51:44.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-04-25T20:51:44.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-04-25T20:51:44.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-04-25T20:51:44.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-04-25T20:51:44.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-04-25T20:51:44.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-04-25T20:51:44.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-04-25T20:51:44.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-04-25T20:51:44.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-04-25T20:51:44.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-04-25T20:51:44.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-04-25T20:51:44.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-04-25T20:51:44.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-04-25T20:51:44.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-04-25T20:51:44.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-04-25T20:51:44.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-04-25T20:51:44.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-04-25T20:51:44.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-04-25T20:51:44.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-04-25T20:51:44.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-04-25T20:51:44.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-04-25T20:51:44.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-04-25T20:51:44.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-04-25T20:51:44.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-04-25T20:51:44.621 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-04-25T20:51:44.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-04-25T20:51:44.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-04-25T20:51:44.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-04-25T20:51:44.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-04-25T20:51:44.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-04-25T20:51:44.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-04-25T20:51:44.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-04-25T20:51:44.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-04-25T20:51:44.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-04-25T20:51:44.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-04-25T20:51:44.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-04-25T20:51:44.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-04-25T20:51:44.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-04-25T20:51:44.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-04-25T20:51:44.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-04-25T20:51:44.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-04-25T20:51:44.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-04-25T20:51:44.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-04-25T20:51:44.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-04-25T20:51:44.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-04-25T20:51:44.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-04-25T20:51:44.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-04-25T20:51:44.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-04-25T20:51:44.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-04-25T20:51:44.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-04-25T20:51:44.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-04-25T20:51:44.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-04-25T20:51:44.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-04-25T20:51:44.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-04-25T20:51:44.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-04-25T20:51:44.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-04-25T20:51:44.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-04-25T20:51:44.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-04-25T20:51:44.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-04-25T20:51:44.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-04-25T20:51:44.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-04-25T20:51:44.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-04-25T20:51:44.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-04-25T20:51:44.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-04-25T20:51:44.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-04-25T20:51:44.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-04-25T20:51:44.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-04-25T20:51:44.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-04-25T20:51:44.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-04-25T20:51:44.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-04-25T20:51:44.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-04-25T20:51:44.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-04-25T20:51:44.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-04-25T20:51:44.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-04-25T20:51:44.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-04-25T20:51:44.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-04-25T20:51:44.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-04-25T20:51:44.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-04-25T20:51:44.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-04-25T20:51:44.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-04-25T20:51:44.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-04-25T20:51:44.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-04-25T20:51:44.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-04-25T20:51:44.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-04-25T20:51:44.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-04-25T20:51:44.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-04-25T20:51:44.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-04-25T20:51:44.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-04-25T20:51:44.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-04-25T20:51:44.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-04-25T20:51:44.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-04-25T20:51:44.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-04-25T20:51:44.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-04-25T20:51:44.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-04-25T20:51:44.698 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-04-25T20:51:44.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-04-25T20:51:44.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-04-25T20:51:44.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-04-25T20:51:44.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-04-25T20:51:44.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-04-25T20:51:44.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-04-25T20:51:44.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-04-25T20:51:44.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-04-25T20:51:44.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-04-25T20:51:44.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-04-25T20:51:44.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-04-25T20:51:44.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-04-25T20:51:44.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-04-25T20:51:44.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-04-25T20:51:44.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-04-25T20:51:44.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-04-25T20:51:44.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-04-25T20:51:44.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-04-25T20:51:44.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-04-25T20:51:44.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-04-25T20:51:44.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-04-25T20:51:44.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-04-25T20:51:44.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-04-25T20:51:44.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-04-25T20:51:44.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-04-25T20:51:44.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-04-25T20:51:44.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-04-25T20:51:44.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-04-25T20:51:44.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-04-25T20:51:44.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-04-25T20:51:44.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-04-25T20:51:44.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-04-25T20:51:44.726 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-04-25T20:51:44.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-04-25T20:51:44.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-04-25T20:51:44.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-04-25T20:51:44.730 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-04-25T20:51:44.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-04-25T20:51:44.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-04-25T20:51:44.732 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-04-25T20:51:44.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-04-25T20:51:44.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-04-25T20:51:44.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-04-25T20:51:44.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-04-25T20:51:44.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-04-25T20:51:44.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-04-25T20:51:44.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-04-25T20:51:44.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-04-25T20:51:44.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-04-25T20:51:44.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-04-25T20:51:44.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-04-25T20:51:44.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-04-25T20:51:44.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-04-25T20:51:44.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-04-25T20:51:44.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-04-25T20:51:44.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-04-25T20:51:44.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-04-25T20:51:44.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-04-25T20:51:44.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-04-25T20:51:44.755 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-04-25T20:51:44.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-04-25T20:51:44.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-04-25T20:51:44.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-04-25T20:51:44.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-04-25T20:51:44.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-04-25T20:51:44.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-04-25T20:51:44.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-04-25T20:51:44.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-04-25T20:51:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-04-25T20:51:44.767 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-04-25T20:51:44.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-04-25T20:51:44.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-04-25T20:51:44.770 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-04-25T20:51:44.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-04-25T20:51:44.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-04-25T20:51:44.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-04-25T20:51:44.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-04-25T20:51:44.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-04-25T20:51:44.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-04-25T20:51:44.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-04-25T20:51:44.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-04-25T20:51:44.781 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-04-25T20:51:44.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-04-25T20:51:44.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-04-25T20:51:44.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-04-25T20:51:44.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-04-25T20:51:44.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-04-25T20:51:44.788 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-04-25T20:51:44.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-04-25T20:51:44.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-04-25T20:51:44.792 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-04-25T20:51:44.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-04-25T20:51:44.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-04-25T20:51:44.796 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-04-25T20:51:44.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-04-25T20:51:44.798 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-04-25T20:51:44.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-04-25T20:51:44.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-04-25T20:51:44.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-04-25T20:51:44.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-04-25T20:51:44.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-04-25T20:51:44.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-04-25T20:51:44.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-04-25T20:51:44.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-04-25T20:51:44.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-04-25T20:51:44.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-04-25T20:51:44.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-04-25T20:51:44.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-04-25T20:51:44.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-04-25T20:51:44.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-04-25T20:51:44.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-04-25T20:51:44.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-04-25T20:51:44.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-04-25T20:51:44.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-04-25T20:51:44.824 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-04-25T20:51:44.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-04-25T20:51:44.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-04-25T20:51:44.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-04-25T20:51:44.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-04-25T20:51:44.833 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-04-25T20:51:44.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-04-25T20:51:44.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-04-25T20:51:44.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-04-25T20:51:44.840 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-04-25T20:51:44.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-04-25T20:51:44.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-04-25T20:51:44.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-04-25T20:51:44.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-04-25T20:51:44.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-04-25T20:51:44.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-04-25T20:51:44.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-04-25T20:51:44.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-04-25T20:51:44.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-04-25T20:51:44.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-04-25T20:51:44.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-04-25T20:51:44.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-04-25T20:51:44.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-04-25T20:51:44.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-04-25T20:51:44.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-04-25T20:51:44.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-04-25T20:51:44.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-04-25T20:51:44.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-04-25T20:51:44.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-04-25T20:51:44.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-04-25T20:51:44.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-04-25T20:51:44.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-04-25T20:51:44.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-04-25T20:51:44.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-04-25T20:51:44.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-04-25T20:51:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-04-25T20:51:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-04-25T20:51:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-04-25T20:51:44.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-04-25T20:51:44.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-04-25T20:51:44.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-04-25T20:51:44.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-04-25T20:51:44.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-04-25T20:51:44.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-04-25T20:51:44.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-04-25T20:51:44.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-04-25T20:51:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-04-25T20:51:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-04-25T20:51:44.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-04-25T20:51:44.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-04-25T20:51:44.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-04-25T20:51:44.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-04-25T20:51:44.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-04-25T20:51:44.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-04-25T20:51:44.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-04-25T20:51:44.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-04-25T20:51:44.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-04-25T20:51:44.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-04-25T20:51:44.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-04-25T20:51:44.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-04-25T20:51:44.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-04-25T20:51:44.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-04-25T20:51:44.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-04-25T20:51:44.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-04-25T20:51:44.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-04-25T20:51:44.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-04-25T20:51:44.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-04-25T20:51:44.921 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-04-25T20:51:44.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-04-25T20:51:44.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-04-25T20:51:44.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-04-25T20:51:44.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-04-25T20:51:44.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-04-25T20:51:44.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-04-25T20:51:44.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-04-25T20:51:44.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-04-25T20:51:44.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-04-25T20:51:44.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-04-25T20:51:44.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-04-25T20:51:44.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-04-25T20:51:44.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-04-25T20:51:44.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-04-25T20:51:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-04-25T20:51:44.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-04-25T20:51:44.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-04-25T20:51:44.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-04-25T20:51:44.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-04-25T20:51:44.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-04-25T20:51:44.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-04-25T20:51:44.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-04-25T20:51:44.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-04-25T20:51:44.962 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-04-25T20:51:44.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-04-25T20:51:44.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-04-25T20:51:44.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-04-25T20:51:44.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-04-25T20:51:44.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-04-25T20:51:44.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-04-25T20:51:44.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-04-25T20:51:44.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-04-25T20:51:44.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-04-25T20:51:44.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-04-25T20:51:44.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-04-25T20:51:44.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-04-25T20:51:44.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-04-25T20:51:44.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-04-25T20:51:44.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-04-25T20:51:44.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-04-25T20:51:44.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-04-25T20:51:44.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-04-25T20:51:44.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-04-25T20:51:44.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-04-25T20:51:45.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-04-25T20:51:45.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-04-25T20:51:45.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-04-25T20:51:45.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-04-25T20:51:45.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-04-25T20:51:45.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-04-25T20:51:45.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-04-25T20:51:45.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-04-25T20:51:45.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-04-25T20:51:45.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-04-25T20:51:45.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-04-25T20:51:45.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-04-25T20:51:45.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-04-25T20:51:45.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-04-25T20:51:45.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-04-25T20:51:45.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-04-25T20:51:45.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-04-25T20:51:45.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-04-25T20:51:45.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-04-25T20:51:45.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-04-25T20:51:45.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-04-25T20:51:45.033 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-04-25T20:51:45.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-04-25T20:51:45.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-04-25T20:51:45.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-04-25T20:51:45.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-04-25T20:51:45.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-04-25T20:51:45.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-04-25T20:51:45.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-04-25T20:51:45.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-04-25T20:51:45.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-04-25T20:51:45.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-04-25T20:51:45.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-04-25T20:51:45.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-04-25T20:51:45.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-04-25T20:51:45.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-04-25T20:51:45.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-04-25T20:51:45.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-04-25T20:51:45.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-04-25T20:51:45.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-04-25T20:51:45.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-04-25T20:51:45.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-04-25T20:51:45.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-04-25T20:51:45.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-04-25T20:51:45.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-04-25T20:51:45.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-04-25T20:51:45.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-04-25T20:51:45.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-04-25T20:51:45.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-04-25T20:51:45.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-04-25T20:51:45.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-04-25T20:51:45.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-04-25T20:51:45.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-04-25T20:51:45.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-04-25T20:51:45.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-04-25T20:51:45.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-04-25T20:51:45.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-04-25T20:51:45.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-04-25T20:51:45.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-04-25T20:51:45.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-04-25T20:51:45.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-04-25T20:51:45.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-04-25T20:51:45.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-04-25T20:51:45.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-04-25T20:51:45.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-04-25T20:51:45.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-04-25T20:51:45.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-04-25T20:51:45.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-04-25T20:51:45.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-04-25T20:51:45.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-04-25T20:51:45.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-04-25T20:51:45.115 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-04-25T20:51:45.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-04-25T20:51:45.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-04-25T20:51:45.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-04-25T20:51:45.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-04-25T20:51:45.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-04-25T20:51:45.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-04-25T20:51:45.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-04-25T20:51:45.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-04-25T20:51:45.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-04-25T20:51:45.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-04-25T20:51:45.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-04-25T20:51:45.131 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-04-25T20:51:45.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-04-25T20:51:45.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-04-25T20:51:45.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-04-25T20:51:45.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-04-25T20:51:45.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-04-25T20:51:45.138 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-04-25T20:51:45.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-04-25T20:51:45.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-04-25T20:51:45.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-04-25T20:51:45.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-04-25T20:51:45.145 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-04-25T20:51:45.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-04-25T20:51:45.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-04-25T20:51:45.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-04-25T20:51:45.150 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-04-25T20:51:45.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-04-25T20:51:45.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-04-25T20:51:45.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-04-25T20:51:45.155 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-04-25T20:51:45.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-04-25T20:51:45.158 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-04-25T20:51:45.159 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-04-25T20:51:45.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-04-25T20:51:45.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-04-25T20:51:45.163 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-04-25T20:51:45.165 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-04-25T20:51:45.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-04-25T20:51:45.168 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-04-25T20:51:45.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-04-25T20:51:45.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-04-25T20:51:45.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-04-25T20:51:45.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-04-25T20:51:45.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-04-25T20:51:45.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-04-25T20:51:45.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-04-25T20:51:45.178 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-04-25T20:51:45.179 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-04-25T20:51:45.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-04-25T20:51:45.182 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-04-25T20:51:45.183 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-04-25T20:51:45.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-04-25T20:51:45.186 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-04-25T20:51:45.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-04-25T20:51:45.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-04-25T20:51:45.189 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-04-25T20:51:45.191 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-04-25T20:51:45.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-04-25T20:51:45.193 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-04-25T20:51:45.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-04-25T20:51:45.196 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-04-25T20:51:45.197 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-04-25T20:51:45.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-04-25T20:51:45.200 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-04-25T20:51:45.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-04-25T20:51:45.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-04-25T20:51:45.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-04-25T20:51:45.205 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-04-25T20:51:45.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-04-25T20:51:45.207 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-04-25T20:51:45.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-04-25T20:51:45.211 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-04-25T20:51:45.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-04-25T20:51:45.214 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-04-25T20:51:45.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-04-25T20:51:45.218 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-04-25T20:51:45.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-04-25T20:51:45.221 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-04-25T20:51:45.223 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-04-25T20:51:45.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-04-25T20:51:45.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-04-25T20:51:45.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-04-25T20:51:45.231 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-04-25T20:51:45.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-04-25T20:51:45.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-04-25T20:51:45.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-04-25T20:51:45.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-04-25T20:51:45.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-04-25T20:51:45.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-04-25T20:51:45.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-04-25T20:51:45.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-04-25T20:51:45.247 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-04-25T20:51:45.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-04-25T20:51:45.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-04-25T20:51:45.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-04-25T20:51:45.254 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-04-25T20:51:45.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-04-25T20:51:45.257 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-04-25T20:51:45.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-04-25T20:51:45.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-04-25T20:51:45.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-04-25T20:51:45.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-04-25T20:51:45.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-04-25T20:51:45.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-04-25T20:51:45.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-04-25T20:51:45.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-04-25T20:51:45.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-04-25T20:51:45.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-04-25T20:51:45.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-04-25T20:51:45.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-04-25T20:51:45.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-04-25T20:51:45.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-04-25T20:51:45.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-04-25T20:51:45.283 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-04-25T20:51:45.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-04-25T20:51:45.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-04-25T20:51:45.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-04-25T20:51:45.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-04-25T20:51:45.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-04-25T20:51:45.291 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-04-25T20:51:45.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-04-25T20:51:45.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-04-25T20:51:45.295 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-04-25T20:51:45.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-04-25T20:51:45.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-04-25T20:51:45.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-04-25T20:51:45.300 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-04-25T20:51:45.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-04-25T20:51:45.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-04-25T20:51:45.304 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-04-25T20:51:45.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-04-25T20:51:45.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-04-25T20:51:45.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-04-25T20:51:45.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-04-25T20:51:45.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-04-25T20:51:45.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-04-25T20:51:45.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-04-25T20:51:45.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-04-25T20:51:45.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-04-25T20:51:45.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-04-25T20:51:45.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-04-25T20:51:45.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-04-25T20:51:45.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-04-25T20:51:45.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-04-25T20:51:45.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-04-25T20:51:45.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-04-25T20:51:45.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-04-25T20:51:45.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-04-25T20:51:45.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-04-25T20:51:45.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-04-25T20:51:45.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-04-25T20:51:45.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-04-25T20:51:45.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-04-25T20:51:45.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-04-25T20:51:45.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-04-25T20:51:45.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-04-25T20:51:45.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-04-25T20:51:45.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-04-25T20:51:45.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-04-25T20:51:45.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-04-25T20:51:45.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-04-25T20:51:45.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-04-25T20:51:45.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-04-25T20:51:45.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-04-25T20:51:45.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-04-25T20:51:45.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-04-25T20:51:45.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-04-25T20:51:45.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-04-25T20:51:45.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-04-25T20:51:45.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-04-25T20:51:45.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-04-25T20:51:45.360 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-04-25T20:51:45.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-04-25T20:51:45.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-04-25T20:51:45.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-04-25T20:51:45.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-04-25T20:51:45.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-04-25T20:51:45.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-04-25T20:51:45.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-04-25T20:51:45.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-04-25T20:51:45.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-04-25T20:51:45.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-04-25T20:51:45.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-04-25T20:51:45.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-04-25T20:51:45.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-04-25T20:51:45.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-04-25T20:51:45.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-04-25T20:51:45.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-04-25T20:51:45.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-04-25T20:51:45.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-04-25T20:51:45.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-04-25T20:51:45.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-04-25T20:51:45.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-04-25T20:51:45.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-04-25T20:51:45.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-04-25T20:51:45.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-04-25T20:51:45.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-04-25T20:51:45.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-04-25T20:51:45.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-04-25T20:51:45.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-04-25T20:51:45.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-04-25T20:51:45.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-04-25T20:51:45.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-04-25T20:51:45.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-04-25T20:51:45.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-04-25T20:51:45.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-04-25T20:51:45.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-04-25T20:51:45.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-04-25T20:51:45.399 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-04-25T20:51:45.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-04-25T20:51:45.401 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-04-25T20:51:45.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-04-25T20:51:45.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-04-25T20:51:45.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-04-25T20:51:45.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-04-25T20:51:45.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-04-25T20:51:45.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-04-25T20:51:45.407 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-04-25T20:51:45.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-04-25T20:51:45.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-04-25T20:51:45.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-04-25T20:51:45.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-04-25T20:51:45.412 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-04-25T20:51:45.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-04-25T20:51:45.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-04-25T20:51:45.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-04-25T20:51:45.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-04-25T20:51:45.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-04-25T20:51:45.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-04-25T20:51:45.418 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-04-25T20:51:45.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-04-25T20:51:45.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-04-25T20:51:45.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-04-25T20:51:45.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-04-25T20:51:45.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-04-25T20:51:45.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-04-25T20:51:45.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-04-25T20:51:45.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-04-25T20:51:45.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-04-25T20:51:45.427 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-04-25T20:51:45.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-04-25T20:51:45.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-04-25T20:51:45.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-04-25T20:51:45.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-04-25T20:51:45.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-04-25T20:51:45.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-04-25T20:51:45.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-04-25T20:51:45.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-04-25T20:51:45.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-04-25T20:51:45.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-04-25T20:51:45.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-04-25T20:51:45.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-04-25T20:51:45.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-04-25T20:51:45.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-04-25T20:51:45.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-04-25T20:51:45.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-04-25T20:51:45.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-04-25T20:51:45.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-04-25T20:51:45.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-04-25T20:51:45.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-04-25T20:51:45.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-04-25T20:51:45.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-04-25T20:51:45.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-04-25T20:51:45.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-04-25T20:51:45.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-04-25T20:51:45.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-04-25T20:51:45.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-04-25T20:51:45.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-04-25T20:51:45.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-04-25T20:51:45.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-04-25T20:51:45.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-04-25T20:51:45.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-04-25T20:51:45.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-04-25T20:51:45.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 -- 172.21.15.43:0/1726110463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c102320 msgr2=0x7fe55c10e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 --2- 172.21.15.43:0/1726110463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c102320 0x7fe55c10e810 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe554009990 tx=0x7fe554009ca0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 -- 172.21.15.43:0/1726110463 shutdown_connections 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 --2- 172.21.15.43:0/1726110463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c107940 0x7fe55c107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 --2- 172.21.15.43:0/1726110463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c102320 0x7fe55c10e810 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 --2- 172.21.15.43:0/1726110463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c101960 0x7fe55c101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 -- 172.21.15.43:0/1726110463 >> 172.21.15.43:0/1726110463 conn(0x7fe55c078960 msgr2=0x7fe55c078d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 -- 172.21.15.43:0/1726110463 shutdown_connections 2024-04-25T20:51:45.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.458+0000 7fe56477a700 1 -- 172.21.15.43:0/1726110463 wait complete. 2024-04-25T20:51:45.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-04-25T20:51:45.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 Processor -- start 2024-04-25T20:51:45.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 -- start start 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 0x7fe55c103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 0x7fe55c103f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c111c50 con 0x7fe55c107940 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c111ad0 con 0x7fe55c102320 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe56477a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c111dd0 con 0x7fe55c101960 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe562d17700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 0x7fe55c103f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:34430/0 (socket says 172.21.15.43:34430) 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 -- 172.21.15.43:0/60392257 learned_addr learned my addr 172.21.15.43:0/60392257 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe562516700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 0x7fe55c103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-04-25T20:51:45.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 -- 172.21.15.43:0/60392257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 msgr2=0x7fe55c103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 0x7fe55c103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 -- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 msgr2=0x7fe55c103f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 0x7fe55c103f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe561d15700 1 -- 172.21.15.43:0/60392257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c1a75a0 con 0x7fe55c102320 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe562d17700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 0x7fe55c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.459+0000 7fe562516700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 0x7fe55c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe561d15700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e9a0 tx=0x7fe55000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe55b7fe700 1 -- 172.21.15.43:0/60392257 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55000cbd0 con 0x7fe55c102320 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c1a7890 con 0x7fe55c102320 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe55b7fe700 1 -- 172.21.15.43:0/60392257 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe55000cd70 con 0x7fe55c102320 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe55b7fe700 1 -- 172.21.15.43:0/60392257 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550018710 con 0x7fe55c102320 2024-04-25T20:51:45.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.460+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c1a7e20 con 0x7fe55c102320 2024-04-25T20:51:45.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-04-25T20:51:45.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-04-25T20:51:45.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-04-25T20:51:45.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.463+0000 7fe55b7fe700 1 -- 172.21.15.43:0/60392257 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe550010430 con 0x7fe55c102320 2024-04-25T20:51:45.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.463+0000 7fe55b7fe700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 0x7fe5440a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.463+0000 7fe562516700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 0x7fe5440a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.463+0000 7fe55b7fe700 1 -- 172.21.15.43:0/60392257 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fe5500d0a50 con 0x7fe55c102320 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 Processor -- start 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe562516700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 0x7fe5440a6390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00e350 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 -- start start 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f2fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 0x561736f3d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561736e82ec0 con 0x561736f2fa80 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561736e29af0 con 0x561736f3b270 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe56f003b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x561736e7ee80 con 0x561736f303a0 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe562516700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f2fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe562516700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f2fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58512/0 (socket says 172.21.15.43:58512) 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe562d17700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 0x561736f3d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe562516700 1 -- 172.21.15.43:0/1506899943 learned_addr learned my addr 172.21.15.43:0/1506899943 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-04-25T20:51:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.464+0000 7fe561d15700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 -- 172.21.15.43:0/1506899943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 msgr2=0x561736f3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f3ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 -- 172.21.15.43:0/1506899943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 msgr2=0x561736f2fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f2fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 -- 172.21.15.43:0/1506899943 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561736dd0a60 con 0x561736f3b270 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe562d17700 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 0x561736f3d660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b2e0 tx=0x7fe5540095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a54400e792217021 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe558ff9700 1 -- 172.21.15.43:0/1506899943 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554027070 con 0x561736f3b270 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe558ff9700 1 -- 172.21.15.43:0/1506899943 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe554003680 con 0x561736f3b270 2024-04-25T20:51:45.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.465+0000 7fe558ff9700 1 -- 172.21.15.43:0/1506899943 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55400f6c0 con 0x561736f3b270 2024-04-25T20:51:45.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- 172.21.15.43:0/1506899943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 msgr2=0x561736f3d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 0x561736f3d660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b2e0 tx=0x7fe5540095e0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- 172.21.15.43:0/1506899943 shutdown_connections 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f3b270 0x561736f3d660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f2fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1506899943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- 172.21.15.43:0/1506899943 >> 172.21.15.43:0/1506899943 conn(0x561736e5d820 msgr2=0x561736f2bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- 172.21.15.43:0/1506899943 shutdown_connections 2024-04-25T20:51:45.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- 172.21.15.43:0/1506899943 wait complete. 2024-04-25T20:51:45.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 -- start start 2024-04-25T20:51:45.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.466+0000 7fe56f003b80 1 Processor -- start 2024-04-25T20:51:45.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 0x561736f3a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736f381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561736f3dc00 con 0x561736f3b270 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561736e21d60 con 0x561736f303a0 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x561736f3dd80 con 0x561736f2fa80 2024-04-25T20:51:45.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe561d15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe56f003b80 10 client.0 _ll_register_callbacks cb 0x561736e1bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736f381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe561d15700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:34456/0 (socket says 172.21.15.43:34456) 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe561d15700 1 -- 172.21.15.43:0/2508616514 learned_addr learned my addr 172.21.15.43:0/2508616514 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562516700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 0x561736f3a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 -- 172.21.15.43:0/2508616514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 msgr2=0x561736f3a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 0x561736f3a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 -- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 msgr2=0x561736f37c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 -- 172.21.15.43:0/2508616514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561736e3a400 con 0x561736f3b270 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe561d15700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562516700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 0x561736f3a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe562d17700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736f381c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe554009ce0 tx=0x7fe554003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19dfcd4b00e964e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.467+0000 7fe541ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:45.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554030060 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fe5540052c0 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe554003680 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe554027040 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 10 client.15588 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561736f48430 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe554003680 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe55402a070 con 0x561736f3b270 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:45.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 10 client.15588 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:45.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 20 client.15588 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:45.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736f4a900 0x561736f4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.476 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-04-25T20:51:45.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 4 client.15588 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:45.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.468+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561736e906b0 con 0x561736f4a900 2024-04-25T20:51:45.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.469+0000 7fe562516700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736f4a900 0x561736f4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.469+0000 7fe562516700 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736f4a900 0x561736f4ccf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288bae40328bcb63 server_cookie=3cdc08f0b02eaa64 in_seq=0 out_seq=0 2024-04-25T20:51:45.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.469+0000 7fe541ffb700 10 client.15588 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:45.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-04-25T20:51:45.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe541ffb700 1 -- 172.21.15.43:0/2508616514 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561736e906b0 con 0x561736f4a900 2024-04-25T20:51:45.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe541ffb700 10 client.15588 handle_command_reply: tid=0 2024-04-25T20:51:45.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 client.15588 shutdown 2024-04-25T20:51:45.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 msgr2=0x561736f381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736f381c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe554009ce0 tx=0x7fe554003e90 comp rx=0 tx=0).stop 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 shutdown_connections 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736f4a900 0x561736f4ccf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f2fa80 0x561736f3a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736f381c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 --2- 172.21.15.43:0/2508616514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f37c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 >> 172.21.15.43:0/2508616514 conn(0x561736e5d820 msgr2=0x561736f2bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe541ffb700 0 client.15588 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 shutdown_connections 2024-04-25T20:51:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.470+0000 7fe56f003b80 1 -- 172.21.15.43:0/2508616514 wait complete. 2024-04-25T20:51:45.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.471+0000 7fe56f003b80 20 client.15588 trim_cache size 0 max 16384 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-04-25T20:51:45.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-04-25T20:51:45.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-04-25T20:51:45.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-04-25T20:51:45.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-04-25T20:51:45.484 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-04-25T20:51:45.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-04-25T20:51:45.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-04-25T20:51:45.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-04-25T20:51:45.489 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-04-25T20:51:45.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-04-25T20:51:45.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-04-25T20:51:45.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-04-25T20:51:45.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.492+0000 7fe56f003b80 1 Processor -- start 2024-04-25T20:51:45.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 -- start start 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f34f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f3b270 0x561736f35440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1af2c0 con 0x561736f2fa80 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1b0e00 con 0x561736f303a0 2024-04-25T20:51:45.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe56f003b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1af990 con 0x561736f3b270 2024-04-25T20:51:45.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58522/0 (socket says 172.21.15.43:58522) 2024-04-25T20:51:45.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 -- 172.21.15.43:0/649248299 learned_addr learned my addr 172.21.15.43:0/649248299 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe561d15700 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f34f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562d17700 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f3b270 0x561736f35440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 -- 172.21.15.43:0/649248299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f3b270 msgr2=0x561736f35440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f3b270 0x561736f35440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 -- 172.21.15.43:0/649248299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 msgr2=0x561736f34f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f34f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 -- 172.21.15.43:0/649248299 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561736f38540 con 0x561736f2fa80 2024-04-25T20:51:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.493+0000 7fe562516700 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe54c007ac0 tx=0x7fe54c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ea36bad7b7ec7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe543fff700 1 -- 172.21.15.43:0/649248299 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c02d030 con 0x561736f2fa80 2024-04-25T20:51:45.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe543fff700 1 -- 172.21.15.43:0/649248299 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe54c015490 con 0x561736f2fa80 2024-04-25T20:51:45.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe543fff700 1 -- 172.21.15.43:0/649248299 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0043c0 con 0x561736f2fa80 2024-04-25T20:51:45.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 -- 172.21.15.43:0/649248299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 msgr2=0x561736f39bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe54c007ac0 tx=0x7fe54c014000 comp rx=0 tx=0).stop 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 -- 172.21.15.43:0/649248299 shutdown_connections 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f3b270 0x561736f35440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f2fa80 0x561736f39bc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 --2- 172.21.15.43:0/649248299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f303a0 0x561736f34f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.494+0000 7fe56f003b80 1 -- 172.21.15.43:0/649248299 >> 172.21.15.43:0/649248299 conn(0x561736e5d820 msgr2=0x561736f394b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- 172.21.15.43:0/649248299 shutdown_connections 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- 172.21.15.43:0/649248299 wait complete. 2024-04-25T20:51:45.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- start start 2024-04-25T20:51:45.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 Processor -- start 2024-04-25T20:51:45.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 0x561736f4da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f4dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1b0730 con 0x561736f3b270 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1b0060 con 0x561736f2fa80 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe56f003b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c1ad280 con 0x561736f303a0 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe562d17700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe562516700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 0x561736f4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe562d17700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58524/0 (socket says 172.21.15.43:58524) 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe562516700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 0x561736f4da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.43:34472/0 (socket says 172.21.15.43:34472) 2024-04-25T20:51:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.495+0000 7fe562d17700 1 -- 172.21.15.43:0/1801338763 learned_addr learned my addr 172.21.15.43:0/1801338763 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe56f003b80 10 client.0 _ll_register_callbacks cb 0x561736e1bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe561d15700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f4dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 -- 172.21.15.43:0/1801338763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 msgr2=0x561736f4dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f4dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 -- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 msgr2=0x561736f4da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 0x561736f4da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 -- 172.21.15.43:0/1801338763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561736fb0020 con 0x561736f3b270 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe562d17700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe55400fed0 tx=0x7fe554003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f327823601111129 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe541ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:45.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-04-25T20:51:45.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554030040 con 0x561736f3b270 2024-04-25T20:51:45.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fe5540054c0 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54c015490 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5540095e0 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe56f003b80 10 client.15594 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.496+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561736fb1300 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe54c015490 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe55402a070 con 0x561736f3b270 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 10 client.15594 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 10 client.15594 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 20 client.15594 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736fb1800 0x561736fb3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 4 client.15594 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.2, "await_for": 42.0}] 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.2, "await_for": 42.0}) -- 0x561736e8a750 con 0x561736fb1800 2024-04-25T20:51:45.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe562516700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736fb1800 0x561736fb3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-04-25T20:51:45.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe541ffb700 10 client.15594 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:45.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:45.497+0000 7fe562516700 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736fb1800 0x561736fb3c20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5234495304a405e9 server_cookie=3f808899a10f0ef4 in_seq=0 out_seq=0 2024-04-25T20:51:45.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-04-25T20:51:45.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 -- 172.21.15.43:0/1393357755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29601010c0 msgr2=0x7f29601014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 --2- 172.21.15.43:0/1393357755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29601010c0 0x7f29601014a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f295002a410 comp rx=0 tx=0).stop 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 -- 172.21.15.43:0/1393357755 shutdown_connections 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 --2- 172.21.15.43:0/1393357755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2960106190 0x7f296010dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 --2- 172.21.15.43:0/1393357755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960101a70 0x7f2960105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 --2- 172.21.15.43:0/1393357755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29601010c0 0x7f29601014a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 -- 172.21.15.43:0/1393357755 >> 172.21.15.43:0/1393357755 conn(0x7f2960077fd0 msgr2=0x7f29600783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 -- 172.21.15.43:0/1393357755 shutdown_connections 2024-04-25T20:51:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.902+0000 7f2964a9a640 1 -- 172.21.15.43:0/1393357755 wait complete. 2024-04-25T20:51:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 Processor -- start 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 -- start start 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29601010c0 0x7f296019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960106190 0x7f296019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2960111230 con 0x7f2960198590 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29601110b0 con 0x7f2960106190 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2964a9a640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29601113b0 con 0x7f29601010c0 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f295ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f295ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54014/0 (socket says 172.21.15.43:54014) 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f295ed9d640 1 -- 172.21.15.43:0/3568191594 learned_addr learned my addr 172.21.15.43:0/3568191594 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.903+0000 7f2957fff640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960106190 0x7f296019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.906 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295e59c640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29601010c0 0x7f296019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 -- 172.21.15.43:0/3568191594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29601010c0 msgr2=0x7f296019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29601010c0 0x7f296019e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 -- 172.21.15.43:0/3568191594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960106190 msgr2=0x7f296019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960106190 0x7f296019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 -- 172.21.15.43:0/3568191594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29601990b0 con 0x7f2960198590 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f295ed9d640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f295800eb10 tx=0x7f295800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f29577fe640 1 -- 172.21.15.43:0/3568191594 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958004b20 con 0x7f2960198590 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29601993a0 con 0x7f2960198590 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f29577fe640 1 -- 172.21.15.43:0/3568191594 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2958004cc0 con 0x7f2960198590 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f29577fe640 1 -- 172.21.15.43:0/3568191594 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958010720 con 0x7f2960198590 2024-04-25T20:51:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.904+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29601a55f0 con 0x7f2960198590 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.906+0000 7f29577fe640 1 -- 172.21.15.43:0/3568191594 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2958005020 con 0x7f2960198590 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.907+0000 7f29677b3740 1 Processor -- start 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.907+0000 7f29677b3740 1 -- start start 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.907+0000 7f29577fe640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 0x7f294c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f2957fff640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 0x7f294c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558356633970 con 0x5583566ddc10 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5583565d04a0 con 0x5583566cee40 2024-04-25T20:51:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29677b3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55835662f930 con 0x5583566ce520 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f29577fe640 1 -- 172.21.15.43:0/3568191594 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f29580d0d90 con 0x7f2960198590 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:36710/0 (socket says 172.21.15.43:36710) 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 -- 172.21.15.43:0/3449197088 learned_addr learned my addr 172.21.15.43:0/3449197088 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f2957fff640 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295ed9d640 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 -- 172.21.15.43:0/3449197088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 msgr2=0x5583566dd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566dd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 -- 172.21.15.43:0/3449197088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 msgr2=0x5583566e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 -- 172.21.15.43:0/3449197088 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558356346210 con 0x5583566ce520 2024-04-25T20:51:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f2957fff640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 0x7f294c0a6280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2960105440 tx=0x7f2948013880 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.908+0000 7f295e59c640 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2950005940 tx=0x7f2950005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc496a049e7c54d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f2954ff9640 1 -- 172.21.15.43:0/3449197088 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f070 con 0x5583566ce520 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f2954ff9640 1 -- 172.21.15.43:0/3449197088 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2950032e50 con 0x5583566ce520 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f2954ff9640 1 -- 172.21.15.43:0/3449197088 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2950035070 con 0x5583566ce520 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 -- 172.21.15.43:0/3449197088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 msgr2=0x5583566ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2950005940 tx=0x7f2950005e80 comp rx=0 tx=0).stop 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 -- 172.21.15.43:0/3449197088 shutdown_connections 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566dd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 --2- 172.21.15.43:0/3449197088 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566ce900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 -- 172.21.15.43:0/3449197088 >> 172.21.15.43:0/3449197088 conn(0x5583566cab30 msgr2=0x5583566caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.909+0000 7f29677b3740 1 -- 172.21.15.43:0/3449197088 shutdown_connections 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 -- 172.21.15.43:0/3449197088 wait complete. 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 -- start start 2024-04-25T20:51:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 Processor -- start 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566cee40 0x5583566da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566ddc10 0x5583566dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5583566e07e0 con 0x5583566ce520 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5583565ce0b0 con 0x5583566ddc10 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5583566e0960 con 0x5583566cee40 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f29677b3740 10 client.0 _ll_register_callbacks cb 0x5583565bbd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f295e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f295e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54036/0 (socket says 172.21.15.43:54036) 2024-04-25T20:51:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f295e59c640 1 -- 172.21.15.43:0/2083035711 learned_addr learned my addr 172.21.15.43:0/2083035711 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f295ed9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566ddc10 0x5583566dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.910+0000 7f2957fff640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566cee40 0x5583566da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 -- 172.21.15.43:0/2083035711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566cee40 msgr2=0x5583566da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566cee40 0x5583566da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 -- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566ddc10 msgr2=0x5583566dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566ddc10 0x5583566dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 -- 172.21.15.43:0/2083035711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558356412620 con 0x5583566ce520 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f295e59c640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f295002a930 tx=0x7f29500317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbfe96fb9f13c46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f2945ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f030 con 0x5583566ce520 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2950032e50 con 0x5583566ce520 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f2950004250 con 0x5583566ce520 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2950035040 con 0x5583566ce520 2024-04-25T20:51:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f29677b3740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583566ec7b0 con 0x5583566ce520 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.911+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2950032e50 con 0x5583566ce520 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f29500035f0 con 0x5583566ce520 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 20 client.15606 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5583566edb00 0x5583566efef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 4 client.15606 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558356641390 con 0x5583566edb00 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f2957fff640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5583566edb00 0x5583566efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f2945ffb640 10 client.15606 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.912+0000 7f2957fff640 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5583566edb00 0x5583566efef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23953857a52ccce server_cookie=66847557ea57a4d7 in_seq=0 out_seq=0 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.917+0000 7f2945ffb640 1 -- 172.21.15.43:0/2083035711 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558356641390 con 0x5583566edb00 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.917+0000 7f2945ffb640 10 client.15606 handle_command_reply: tid=0 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.917+0000 7f29677b3740 1 client.15606 shutdown 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 msgr2=0x5583566dd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f295002a930 tx=0x7f29500317c0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 shutdown_connections 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5583566edb00 0x5583566efef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566ddc10 0x5583566dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566cee40 0x5583566da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f2945ffb640 0 client.15606 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 --2- 172.21.15.43:0/2083035711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566dd590 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 >> 172.21.15.43:0/2083035711 conn(0x5583566cab30 msgr2=0x5583566d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 shutdown_connections 2024-04-25T20:51:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 1 -- 172.21.15.43:0/2083035711 wait complete. 2024-04-25T20:51:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.918+0000 7f29677b3740 20 client.15606 trim_cache size 0 max 16384 2024-04-25T20:51:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 Processor -- start 2024-04-25T20:51:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 -- start start 2024-04-25T20:51:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f29601ab9e0 con 0x5583566ddc10 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29601ad520 con 0x5583566cee40 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f29677b3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29601ac0b0 con 0x5583566ce520 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54050/0 (socket says 172.21.15.43:54050) 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 -- 172.21.15.43:0/4290375765 learned_addr learned my addr 172.21.15.43:0/4290375765 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295e59c640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f2957fff640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 -- 172.21.15.43:0/4290375765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 msgr2=0x5583566dd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566dd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 -- 172.21.15.43:0/4290375765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 msgr2=0x5583566f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f295ed9d640 1 -- 172.21.15.43:0/4290375765 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583566e0000 con 0x5583566ddc10 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.933+0000 7f2957fff640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f295ed9d640 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f295809cc90 tx=0x7f295801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0758cb448fe1def server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f2947fff640 1 -- 172.21.15.43:0/4290375765 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29580b6260 con 0x5583566ddc10 2024-04-25T20:51:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f2947fff640 1 -- 172.21.15.43:0/4290375765 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f295809cd00 con 0x5583566ddc10 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f2947fff640 1 -- 172.21.15.43:0/4290375765 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29580a54e0 con 0x5583566ddc10 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 -- 172.21.15.43:0/4290375765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 msgr2=0x5583566f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f295809cc90 tx=0x7f295801a040 comp rx=0 tx=0).stop 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 -- 172.21.15.43:0/4290375765 shutdown_connections 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ddc10 0x5583566f3450 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 --2- 172.21.15.43:0/4290375765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ce520 0x5583566dd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 -- 172.21.15.43:0/4290375765 >> 172.21.15.43:0/4290375765 conn(0x5583566cab30 msgr2=0x5583566d5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 -- 172.21.15.43:0/4290375765 shutdown_connections 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.934+0000 7f29677b3740 1 -- 172.21.15.43:0/4290375765 wait complete. 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 -- start start 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 Processor -- start 2024-04-25T20:51:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ddc10 0x5583566f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f29601ace50 con 0x5583566ce520 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29601ac780 con 0x5583566cee40 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f29601a99c0 con 0x5583566ddc10 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f29677b3740 10 client.0 _ll_register_callbacks cb 0x7f29580093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54052/0 (socket says 172.21.15.43:54052) 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 -- 172.21.15.43:0/2541167431 learned_addr learned my addr 172.21.15.43:0/2541167431 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295ed9d640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ddc10 0x5583566f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f2957fff640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 -- 172.21.15.43:0/2541167431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ddc10 msgr2=0x5583566f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ddc10 0x5583566f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 -- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 msgr2=0x5583566f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.935+0000 7f295e59c640 1 -- 172.21.15.43:0/2541167431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558356752ce0 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f295e59c640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f2950003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b72219bd65f11a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295003f070 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f295809cd00 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f2950004450 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2950065050 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 10 client.15612 fetch_fsmap learned FSMap version 28 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558356753e90 con 0x5583566ce520 2024-04-25T20:51:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f295809cd00 con 0x5583566ce520 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f2950055580 con 0x5583566ce520 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 10 client.15612 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 20 client.15612 populate_metadata read hostname 'smithi043' 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x558356754550 0x558356756970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 4 client.15612 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55835663b200 con 0x558356754550 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.936+0000 7f2957fff640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x558356754550 0x558356756970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.937+0000 7f2957fff640 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x558356754550 0x558356756970 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b32622de4d44fa server_cookie=46483b8847591c00 in_seq=0 out_seq=0 2024-04-25T20:51:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:45.937+0000 7f2945ffb640 10 client.15612 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:46.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:46 smithi043 ceph-mon[29167]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.1 MiB/s wr, 58 op/s 2024-04-25T20:51:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:46 smithi195 ceph-mon[33250]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.1 MiB/s wr, 58 op/s 2024-04-25T20:51:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:46 smithi112 ceph-mon[32322]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.1 MiB/s wr, 58 op/s 2024-04-25T20:51:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f2945ffb640 1 -- 172.21.15.43:0/2541167431 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55835663b200 con 0x558356754550 2024-04-25T20:51:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f2945ffb640 10 client.15612 handle_command_reply: tid=0 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 client.15612 shutdown 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 msgr2=0x5583566f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2950009900 tx=0x7f2950003820 comp rx=0 tx=0).stop 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 shutdown_connections 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x558356754550 0x558356756970 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5583566ddc10 0x5583566f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5583566cee40 0x5583566f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 --2- 172.21.15.43:0/2541167431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583566ce520 0x5583566f3400 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f2945ffb640 0 client.15612 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.563+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 >> 172.21.15.43:0/2541167431 conn(0x5583566cab30 msgr2=0x5583566d5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 shutdown_connections 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f29677b3740 1 -- 172.21.15.43:0/2541167431 wait complete. 2024-04-25T20:51:47.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f29677b3740 20 client.15612 trim_cache size 0 max 16384 2024-04-25T20:51:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:51:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:51:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:51:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 msgr2=0x7f294c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 0x7f294c0a6280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2960105440 tx=0x7f2948013880 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 msgr2=0x7f2960198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.564+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f295800eb10 tx=0x7f295800c2d0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 shutdown_connections 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f294c0a3dc0 0x7f294c0a6280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2960198590 0x7f2960198a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2960106190 0x7f296019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 --2- 172.21.15.43:0/3568191594 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29601010c0 0x7f296019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 >> 172.21.15.43:0/3568191594 conn(0x7f2960077fd0 msgr2=0x7f296006aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 shutdown_connections 2024-04-25T20:51:47.567 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:51:47.565+0000 7f2964a9a640 1 -- 172.21.15.43:0/3568191594 wait complete. 2024-04-25T20:51:48.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:48 smithi043 ceph-mon[29167]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:48 smithi195 ceph-mon[33250]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:48.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:48 smithi112 ceph-mon[32322]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe541ffb700 1 -- 172.21.15.43:0/1801338763 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x561736e8a750 con 0x561736fb1800 2024-04-25T20:51:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe541ffb700 10 client.15594 handle_command_reply: tid=0 2024-04-25T20:51:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 client.15594 shutdown 2024-04-25T20:51:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 msgr2=0x561736fafae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe55400fed0 tx=0x7fe554003be0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 shutdown_connections 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x561736fb1800 0x561736fb3c20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561736f3b270 0x561736fafae0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561736f2fa80 0x561736f4da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 --2- 172.21.15.43:0/1801338763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561736f303a0 0x561736f4dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe541ffb700 0 client.15594 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 >> 172.21.15.43:0/1801338763 conn(0x561736e5d820 msgr2=0x561736f39d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 shutdown_connections 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 1 -- 172.21.15.43:0/1801338763 wait complete. 2024-04-25T20:51:48.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.721+0000 7fe56f003b80 20 client.15594 trim_cache size 0 max 16384 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 28, 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "leader": 24470, 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "set_version": 6, 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "sets": { 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "ae7ddaac": { 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "version": 6, 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "age_ref": 0.0, 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "QUIESCED", 2024-04-25T20:51:48.724 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "timeout": 60.0, 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "expiration": 86.2, 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "members": { 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "file:/": { 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "excluded": false, 2024-04-25T20:51:48.725 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "QUIESCED", 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:51:48.726 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 msgr2=0x7fe5440a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 0x7fe5440a6390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00e350 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 msgr2=0x7fe55c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e9a0 tx=0x7fe55000ecb0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 shutdown_connections 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe5440a3ed0 0x7fe5440a6390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55c101960 0x7fe55c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe55c107940 0x7fe55c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 --2- 172.21.15.43:0/60392257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe55c102320 0x7fe55c103a50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 >> 172.21.15.43:0/60392257 conn(0x7fe55c078960 msgr2=0x7fe55c105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 shutdown_connections 2024-04-25T20:51:48.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:51:48.722+0000 7fe56477a700 1 -- 172.21.15.43:0/60392257 wait complete. 2024-04-25T20:51:49.617 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ae7ddaac', quiesce took 11.0 seconds. Will release after: 26.2 2024-04-25T20:51:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:50 smithi195 ceph-mon[33250]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:50 smithi112 ceph-mon[32322]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:50.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:50 smithi043 ceph-mon[29167]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.1 MiB/s wr, 53 op/s 2024-04-25T20:51:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:52 smithi195 ceph-mon[33250]: pgmap v59: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:52 smithi112 ceph-mon[32322]: pgmap v59: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:52.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:52 smithi043 ceph-mon[29167]: pgmap v59: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:54 smithi195 ceph-mon[33250]: pgmap v60: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 7.8 MiB/s wr, 581 op/s 2024-04-25T20:51:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:54 smithi112 ceph-mon[32322]: pgmap v60: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 7.8 MiB/s wr, 581 op/s 2024-04-25T20:51:54.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:54 smithi043 ceph-mon[29167]: pgmap v60: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 7.8 MiB/s wr, 581 op/s 2024-04-25T20:51:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:56 smithi195 ceph-mon[33250]: pgmap v61: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:56 smithi112 ceph-mon[32322]: pgmap v61: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:56.346 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:56 smithi043 ceph-mon[29167]: pgmap v61: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 7.8 MiB/s wr, 586 op/s 2024-04-25T20:51:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:58 smithi195 ceph-mon[33250]: pgmap v62: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:51:58.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:58 smithi112 ceph-mon[32322]: pgmap v62: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:51:58.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:58 smithi043 ceph-mon[29167]: pgmap v62: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:51:59.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:51:59 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:51:59.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:51:59 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:51:59.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:51:59 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:00.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:00 smithi195 ceph-mon[33250]: pgmap v63: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:52:00.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:00 smithi112 ceph-mon[32322]: pgmap v63: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:52:00.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:00 smithi043 ceph-mon[29167]: pgmap v63: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 750 KiB/s wr, 538 op/s 2024-04-25T20:52:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 -- 172.21.15.43:0/4253371022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c102b80 msgr2=0x7fa73c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 --2- 172.21.15.43:0/4253371022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c102b80 0x7fa73c106bc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa724009900 tx=0x7fa72402a410 comp rx=0 tx=0).stop 2024-04-25T20:52:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 -- 172.21.15.43:0/4253371022 shutdown_connections 2024-04-25T20:52:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 --2- 172.21.15.43:0/4253371022 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 0x7fa73c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 --2- 172.21.15.43:0/4253371022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c102b80 0x7fa73c106bc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 --2- 172.21.15.43:0/4253371022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 0x7fa73c1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 -- 172.21.15.43:0/4253371022 >> 172.21.15.43:0/4253371022 conn(0x7fa73c0793e0 msgr2=0x7fa73c0797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 -- 172.21.15.43:0/4253371022 shutdown_connections 2024-04-25T20:52:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.667+0000 7fa741115640 1 -- 172.21.15.43:0/4253371022 wait complete. 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.668+0000 7fa741115640 1 Processor -- start 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.668+0000 7fa741115640 1 -- start start 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 0x7fa73c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 0x7fa73c198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112300 con 0x7fa73c19d020 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112180 con 0x7fa73c1021d0 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa741115640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112480 con 0x7fa73c1072a0 2024-04-25T20:52:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39876/0 (socket says 172.21.15.43:39876) 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 -- 172.21.15.43:0/3158747597 learned_addr learned my addr 172.21.15.43:0/3158747597 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 0x7fa73c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73259c640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 0x7fa73c198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 -- 172.21.15.43:0/3158747597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 msgr2=0x7fa73c198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 0x7fa73c198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 -- 172.21.15.43:0/3158747597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 msgr2=0x7fa73c198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 0x7fa73c198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.669+0000 7fa73b59e640 1 -- 172.21.15.43:0/3158747597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19db10 con 0x7fa73c19d020 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa73b59e640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa73400e960 tx=0x7fa73400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa738d99640 1 -- 172.21.15.43:0/3158747597 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734004d20 con 0x7fa73c19d020 2024-04-25T20:52:00.673 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa738d99640 1 -- 172.21.15.43:0/3158747597 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa734005020 con 0x7fa73c19d020 2024-04-25T20:52:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa738d99640 1 -- 172.21.15.43:0/3158747597 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340116d0 con 0x7fa73c19d020 2024-04-25T20:52:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19de00 con 0x7fa73c19d020 2024-04-25T20:52:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.670+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c1a5570 con 0x7fa73c19d020 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.672+0000 7fa738d99640 1 -- 172.21.15.43:0/3158747597 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa7340051d0 con 0x7fa73c19d020 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 Processor -- start 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 -- start start 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fac4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56106fa1c970 con 0x56106fab7620 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56106f9b94a0 con 0x56106fab7f40 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa743e20740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56106fa18930 con 0x56106fac2800 2024-04-25T20:52:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa738d99640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 0x7fa7280a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39890/0 (socket says 172.21.15.43:39890) 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa73259c640 1 -- 172.21.15.43:0/3968852369 learned_addr learned my addr 172.21.15.43:0/3968852369 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.673+0000 7fa73b59e640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 0x7fa7280a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fac4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa738d99640 1 -- 172.21.15.43:0/3158747597 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa7340d0840 con 0x7fa73c19d020 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 -- 172.21.15.43:0/3968852369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 msgr2=0x56106fac4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fac4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 -- 172.21.15.43:0/3968852369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 msgr2=0x56106fac22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 -- 172.21.15.43:0/3968852369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106f72f210 con 0x56106fab7620 2024-04-25T20:52:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73259c640 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa73c06b630 tx=0x7fa724000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c7792f88ada56e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73b59e640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 0x7fa7280a6280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7340a4f50 tx=0x7fa73406c1a0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73159a640 1 -- 172.21.15.43:0/3968852369 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724044020 con 0x56106fab7620 2024-04-25T20:52:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73159a640 1 -- 172.21.15.43:0/3968852369 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa724031710 con 0x56106fab7620 2024-04-25T20:52:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.674+0000 7fa73159a640 1 -- 172.21.15.43:0/3968852369 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724035040 con 0x56106fab7620 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- 172.21.15.43:0/3968852369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 msgr2=0x56106fab7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa73c06b630 tx=0x7fa724000bc0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- 172.21.15.43:0/3968852369 shutdown_connections 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fac4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 --2- 172.21.15.43:0/3968852369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fab7a00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.682 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- 172.21.15.43:0/3968852369 >> 172.21.15.43:0/3968852369 conn(0x56106fab3b30 msgr2=0x56106fab3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- 172.21.15.43:0/3968852369 shutdown_connections 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- 172.21.15.43:0/3968852369 wait complete. 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 -- start start 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.675+0000 7fa743e20740 1 Processor -- start 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fabf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fabfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56106fac53d0 con 0x56106fab7620 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56106f9b70b0 con 0x56106fac2800 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56106fac5550 con 0x56106fab7f40 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa743e20740 10 client.0 _ll_register_callbacks cb 0x56106f9a4d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39906/0 (socket says 172.21.15.43:39906) 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 -- 172.21.15.43:0/1478942077 learned_addr learned my addr 172.21.15.43:0/1478942077 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:00.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fabf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fabfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 -- 172.21.15.43:0/1478942077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 msgr2=0x56106fabf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fabf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 -- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 msgr2=0x56106fabfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fabfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 -- 172.21.15.43:0/1478942077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56106f7fb620 con 0x56106fab7620 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fabf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa73259c640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa724004730 tx=0x7fa7240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b3428168da3c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.676+0000 7fa7227fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724035040 con 0x56106fab7620 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa724031710 con 0x56106fab7620 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa72404b410 con 0x56106fab7620 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa724044040 con 0x56106fab7620 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 10 client.15624 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:00.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56106fad1320 con 0x56106fab7620 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa724031710 con 0x56106fab7620 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fa72403d510 con 0x56106fab7620 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 10 client.15624 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 20 client.15624 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fad2670 0x56106fad4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 4 client.15624 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.677+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56106fa2a390 con 0x56106fad2670 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.678+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fad2670 0x56106fad4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.678+0000 7fa7227fc640 10 client.15624 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.678+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fad2670 0x56106fad4a60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664dda71e94b2c23 server_cookie=c6198e18d71cf845 in_seq=0 out_seq=0 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa7227fc640 1 -- 172.21.15.43:0/1478942077 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56106fa2a390 con 0x56106fad2670 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa7227fc640 10 client.15624 handle_command_reply: tid=0 2024-04-25T20:52:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 client.15624 shutdown 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 msgr2=0x56106fac2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa724004730 tx=0x7fa7240046c0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 shutdown_connections 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fad2670 0x56106fad4a60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fabfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa7227fc640 0 client.15624 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fabf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 --2- 172.21.15.43:0/1478942077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fac2190 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 >> 172.21.15.43:0/1478942077 conn(0x56106fab3b30 msgr2=0x56106fab98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 shutdown_connections 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 1 -- 172.21.15.43:0/1478942077 wait complete. 2024-04-25T20:52:00.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.679+0000 7fa743e20740 20 client.15624 trim_cache size 0 max 16384 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 Processor -- start 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 -- start start 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fad7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ada70 con 0x56106fab7620 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1af5e0 con 0x56106fab7f40 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.694+0000 7fa743e20740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ae140 con 0x56106fac2800 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39912/0 (socket says 172.21.15.43:39912) 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 -- 172.21.15.43:0/2336818696 learned_addr learned my addr 172.21.15.43:0/2336818696 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:00.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 -- 172.21.15.43:0/2336818696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 msgr2=0x56106fad7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fad7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 -- 172.21.15.43:0/2336818696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 msgr2=0x56106fac1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 -- 172.21.15.43:0/2336818696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106fab7d70 con 0x56106fab7620 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa73259c640 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa72403d8e0 tx=0x7fa72402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fda2aee7930651 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa730d99640 1 -- 172.21.15.43:0/2336818696 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724035040 con 0x56106fab7620 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa730d99640 1 -- 172.21.15.43:0/2336818696 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa72403db50 con 0x56106fab7620 2024-04-25T20:52:00.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.695+0000 7fa730d99640 1 -- 172.21.15.43:0/2336818696 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724054d10 con 0x56106fab7620 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- 172.21.15.43:0/2336818696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 msgr2=0x56106facdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa72403d8e0 tx=0x7fa72402a410 comp rx=0 tx=0).stop 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- 172.21.15.43:0/2336818696 shutdown_connections 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fac2800 0x56106fad7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fab7f40 0x56106fac1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 --2- 172.21.15.43:0/2336818696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106facdeb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- 172.21.15.43:0/2336818696 >> 172.21.15.43:0/2336818696 conn(0x56106fab3b30 msgr2=0x56106facd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- 172.21.15.43:0/2336818696 shutdown_connections 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- 172.21.15.43:0/2336818696 wait complete. 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 -- start start 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.696+0000 7fa743e20740 1 Processor -- start 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fad7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fad4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1aeee0 con 0x56106fab7620 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ae810 con 0x56106fac2800 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1aba50 con 0x56106fab7f40 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 10 client.0 _ll_register_callbacks cb 0x7fa7240319b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39914/0 (socket says 172.21.15.43:39914) 2024-04-25T20:52:00.705 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 -- 172.21.15.43:0/791084812 learned_addr learned my addr 172.21.15.43:0/791084812 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 -- 172.21.15.43:0/791084812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 msgr2=0x56106fad7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fad7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 -- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 msgr2=0x56106fad4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fad4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 -- 172.21.15.43:0/791084812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56106fad5420 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa73259c640 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa72403da50 tx=0x7fa72403df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b243655606ccd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa7227fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724063070 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa724054440 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa72403db50 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa724054640 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 10 client.15630 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.697+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56106fb382e0 con 0x56106fab7620 2024-04-25T20:52:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa72403db50 con 0x56106fab7620 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fa724003850 con 0x56106fab7620 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 10 client.15630 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 20 client.15630 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fb387e0 0x56106fb3ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 4 client.15630 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56106fa24200 con 0x56106fb387e0 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fb387e0 0x56106fb3ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa7227fc640 10 client.15630 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.698+0000 7fa73ad9d640 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fb387e0 0x56106fb3ac00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad592407b936ffab server_cookie=13eb37a39f7715d8 in_seq=0 out_seq=0 2024-04-25T20:52:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa7227fc640 1 -- 172.21.15.43:0/791084812 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56106fa24200 con 0x56106fb387e0 2024-04-25T20:52:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa7227fc640 10 client.15630 handle_command_reply: tid=0 2024-04-25T20:52:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 client.15630 shutdown 2024-04-25T20:52:00.814 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 msgr2=0x56106fad77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa72403da50 tx=0x7fa72403df10 comp rx=0 tx=0).stop 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 shutdown_connections 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56106fb387e0 0x56106fb3ac00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56106fac2800 0x56106fad4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa7227fc640 0 client.15630 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56106fab7f40 0x56106fad7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 --2- 172.21.15.43:0/791084812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56106fab7620 0x56106fad77b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 >> 172.21.15.43:0/791084812 conn(0x56106fab3b30 msgr2=0x56106face030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 shutdown_connections 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 1 -- 172.21.15.43:0/791084812 wait complete. 2024-04-25T20:52:00.815 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.812+0000 7fa743e20740 20 client.15630 trim_cache size 0 max 16384 2024-04-25T20:52:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:52:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:52:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:52:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 msgr2=0x7fa7280a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 0x7fa7280a6280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7340a4f50 tx=0x7fa73406c1a0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 msgr2=0x7fa73c19d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa73400e960 tx=0x7fa73400ee20 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 shutdown_connections 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa7280a3dc0 0x7fa7280a6280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa73c19d020 0x7fa73c19d4d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa73c1072a0 0x7fa73c198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 --2- 172.21.15.43:0/3158747597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa73c1021d0 0x7fa73c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 >> 172.21.15.43:0/3158747597 conn(0x7fa73c0793e0 msgr2=0x7fa73c0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 shutdown_connections 2024-04-25T20:52:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:00.813+0000 7fa741115640 1 -- 172.21.15.43:0/3158747597 wait complete. 2024-04-25T20:52:01.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:01 smithi043 ceph-mon[29167]: pgmap v64: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 757 KiB/s wr, 544 op/s 2024-04-25T20:52:01.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:01 smithi195 ceph-mon[33250]: pgmap v64: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 757 KiB/s wr, 544 op/s 2024-04-25T20:52:01.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:01 smithi112 ceph-mon[32322]: pgmap v64: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 757 KiB/s wr, 544 op/s 2024-04-25T20:52:03.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:03 smithi043 ceph-mon[29167]: pgmap v65: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-04-25T20:52:03.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:03 smithi195 ceph-mon[33250]: pgmap v65: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-04-25T20:52:03.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:03 smithi112 ceph-mon[32322]: pgmap v65: 97 pgs: 97 active+clean; 88 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-04-25T20:52:05.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:05 smithi043 ceph-mon[29167]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 134 KiB/s wr, 75 op/s 2024-04-25T20:52:05.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:05 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:52:05.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:05 smithi195 ceph-mon[33250]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 134 KiB/s wr, 75 op/s 2024-04-25T20:52:05.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:05 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:52:05.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:05 smithi112 ceph-mon[32322]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 134 KiB/s wr, 75 op/s 2024-04-25T20:52:05.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:05 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:52:06.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:52:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:52:06.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:52:06.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:52:06.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:52:06.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:52:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:52:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:52:06.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:52:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:07 smithi043 ceph-mon[29167]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:07 smithi195 ceph-mon[33250]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:07 smithi112 ceph-mon[32322]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:09 smithi043 ceph-mon[29167]: pgmap v68: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:09 smithi195 ceph-mon[33250]: pgmap v68: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:09 smithi112 ceph-mon[32322]: pgmap v68: 97 pgs: 97 active+clean; 84 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-04-25T20:52:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:11 smithi043 ceph-mon[29167]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 536 KiB/s wr, 180 op/s 2024-04-25T20:52:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:11 smithi195 ceph-mon[33250]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 536 KiB/s wr, 180 op/s 2024-04-25T20:52:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:11 smithi112 ceph-mon[32322]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 536 KiB/s wr, 180 op/s 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 -- 172.21.15.43:0/866841096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 msgr2=0x7f2fc01035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/866841096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc01035e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009ca0 tx=0x7f2fb002a950 comp rx=0 tx=0).stop 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 -- 172.21.15.43:0/866841096 shutdown_connections 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/866841096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/866841096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fc0103b20 0x7f2fc010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/866841096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc01035e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 -- 172.21.15.43:0/866841096 >> 172.21.15.43:0/866841096 conn(0x7f2fc0077fd0 msgr2=0x7f2fc00783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 -- 172.21.15.43:0/866841096 shutdown_connections 2024-04-25T20:52:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.913+0000 7f2fc5c49640 1 -- 172.21.15.43:0/866841096 wait complete. 2024-04-25T20:52:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 Processor -- start 2024-04-25T20:52:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 -- start start 2024-04-25T20:52:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fc0103b20 0x7f2fc0101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc01018d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112390 con 0x7f2fc0103200 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112210 con 0x7f2fc010c540 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fc5c49640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112510 con 0x7f2fc0103b20 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fbf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fbf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35154/0 (socket says 172.21.15.43:35154) 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/790617079 learned_addr learned my addr 172.21.15.43:0/790617079 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.914+0000 7f2fbffff640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc01018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/790617079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fc0103b20 msgr2=0x7f2fc0101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fc0103b20 0x7f2fc0101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/790617079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 msgr2=0x7f2fc01018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc01018d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/790617079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc01a6cf0 con 0x7f2fc0103200 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbffff640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0005e30 tx=0x7f2fb0003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbcff9640 1 -- 172.21.15.43:0/790617079 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0034040 con 0x7f2fc0103200 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbcff9640 1 -- 172.21.15.43:0/790617079 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fb002fdf0 con 0x7f2fc0103200 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc01a6f80 con 0x7f2fc0103200 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc01a73e0 con 0x7f2fc0103200 2024-04-25T20:52:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.915+0000 7f2fbcff9640 1 -- 172.21.15.43:0/790617079 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0004840 con 0x7f2fc0103200 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.917+0000 7f2fbcff9640 1 -- 172.21.15.43:0/790617079 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2fb0037020 con 0x7f2fc0103200 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 Processor -- start 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 -- start start 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbcff9640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 0x7f2fa80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55778e00c970 con 0x55778e0a7620 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55778dfa94a0 con 0x55778e0b2800 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55778e008930 con 0x55778e0a7f40 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35160/0 (socket says 172.21.15.43:35160) 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 0x7f2fa80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 -- 172.21.15.43:0/2710170436 learned_addr learned my addr 172.21.15.43:0/2710170436 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbcff9640 1 -- 172.21.15.43:0/790617079 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f2fb00f1760 con 0x7f2fc0103200 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 -- 172.21.15.43:0/2710170436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 msgr2=0x55778e0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 -- 172.21.15.43:0/2710170436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 msgr2=0x55778e0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.918+0000 7f2fbffff640 1 -- 172.21.15.43:0/2710170436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778dd1f210 con 0x55778e0a7620 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 0x7f2fa80a6280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fc01028e0 tx=0x7f2fb4006c90 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80135c0 tx=0x7f2fb8009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9060df7a4e5ea88d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fa5ffb640 1 -- 172.21.15.43:0/2710170436 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8013270 con 0x55778e0a7620 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fa5ffb640 1 -- 172.21.15.43:0/2710170436 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fb8011940 con 0x55778e0a7620 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fa5ffb640 1 -- 172.21.15.43:0/2710170436 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800f9a0 con 0x55778e0a7620 2024-04-25T20:52:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2710170436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 msgr2=0x55778e0a7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.919+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80135c0 tx=0x7f2fb8009830 comp rx=0 tx=0).stop 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2710170436 shutdown_connections 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2710170436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0a7a00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2710170436 >> 172.21.15.43:0/2710170436 conn(0x55778e0a3b30 msgr2=0x55778e0a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2710170436 shutdown_connections 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2710170436 wait complete. 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- start start 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 Processor -- start 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7620 0x55778e0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.920+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55778e0b5430 con 0x55778e0a7f40 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55778dfa70b0 con 0x55778e0b2800 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55778e0b55b0 con 0x55778e0a7620 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fc8a35740 10 client.0 _ll_register_callbacks cb 0x55778df94d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35174/0 (socket says 172.21.15.43:35174) 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 -- 172.21.15.43:0/2642301925 learned_addr learned my addr 172.21.15.43:0/2642301925 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7620 0x55778e0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 -- 172.21.15.43:0/2642301925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7620 msgr2=0x55778e0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7620 0x55778e0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 -- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 msgr2=0x55778e0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 -- 172.21.15.43:0/2642301925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778ddeb620 con 0x55778e0a7f40 2024-04-25T20:52:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbffff640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40090d0 tx=0x7f2fb40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e698582e9d45a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2f9effd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4023060 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f2fb400be40 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.921+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb8011940 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2fb4028480 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 10 client.15642 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55778e0c1430 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fb8011940 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f2fb4012540 con 0x55778e0a7f40 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 10 client.15642 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 20 client.15642 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e0c2960 0x55778e0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 4 client.15642 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55778e01a390 con 0x55778e0c2960 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.922+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e0c2960 0x55778e0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.923+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e0c2960 0x55778e0c4d50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a82ebbe887bf398 server_cookie=410d58ec225dc18b in_seq=0 out_seq=0 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.923+0000 7f2f9effd640 10 client.15642 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2f9effd640 1 -- 172.21.15.43:0/2642301925 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55778e01a390 con 0x55778e0c2960 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2f9effd640 10 client.15642 handle_command_reply: tid=0 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 client.15642 shutdown 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 msgr2=0x55778e0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40090d0 tx=0x7f2fb40047d0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 shutdown_connections 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e0c2960 0x55778e0c4d50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7f40 0x55778e0af480 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2f9effd640 0 client.15642 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/2642301925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7620 0x55778e0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 >> 172.21.15.43:0/2642301925 conn(0x55778e0a3b30 msgr2=0x55778e0a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 shutdown_connections 2024-04-25T20:52:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 1 -- 172.21.15.43:0/2642301925 wait complete. 2024-04-25T20:52:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.924+0000 7f2fc8a35740 20 client.15642 trim_cache size 0 max 16384 2024-04-25T20:52:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 Processor -- start 2024-04-25T20:52:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 -- start start 2024-04-25T20:52:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01afd40 con 0x55778e0a7620 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01b18b0 con 0x55778e0b2800 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01b0410 con 0x55778e0a7f40 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fbf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fbf7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35178/0 (socket says 172.21.15.43:35178) 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.939+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/3908695766 learned_addr learned my addr 172.21.15.43:0/3908695766 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbffff640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/3908695766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 msgr2=0x55778e0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/3908695766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 msgr2=0x55778e0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 -- 172.21.15.43:0/3908695766 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778e0afd70 con 0x55778e0a7620 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbffff640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00eeff0 tx=0x7f2fb00a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f777eb39e842f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fa57fa640 1 -- 172.21.15.43:0/3908695766 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb002c040 con 0x55778e0a7620 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fa57fa640 1 -- 172.21.15.43:0/3908695766 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fb00c6450 con 0x55778e0a7620 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.940+0000 7f2fa57fa640 1 -- 172.21.15.43:0/3908695766 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00e2240 con 0x55778e0a7620 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- 172.21.15.43:0/3908695766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 msgr2=0x55778e0be2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00eeff0 tx=0x7f2fb00a8040 comp rx=0 tx=0).stop 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- 172.21.15.43:0/3908695766 shutdown_connections 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0b2800 0x55778e0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/3908695766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0a7620 0x55778e0be2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- 172.21.15.43:0/3908695766 >> 172.21.15.43:0/3908695766 conn(0x55778e0a3b30 msgr2=0x55778e0aa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- 172.21.15.43:0/3908695766 shutdown_connections 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- 172.21.15.43:0/3908695766 wait complete. 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- start start 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 Processor -- start 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0a7620 0x55778e0ba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01b11b0 con 0x55778e0b2800 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01b0ae0 con 0x55778e0a7620 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.941+0000 7f2fc8a35740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc01add20 con 0x55778e0a7f40 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fc8a35740 10 client.0 _ll_register_callbacks cb 0x7f2fb4015cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35190/0 (socket says 172.21.15.43:35190) 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 -- 172.21.15.43:0/874223353 learned_addr learned my addr 172.21.15.43:0/874223353 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0a7620 0x55778e0ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 -- 172.21.15.43:0/874223353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 msgr2=0x55778e0b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 -- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0a7620 msgr2=0x55778e0ba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0a7620 0x55778e0ba860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 -- 172.21.15.43:0/874223353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778e0b6840 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbeffd640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fbffff640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2fb801d000 tx=0x7f2fb8009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae90d29f91a740db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2f9effd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb802e060 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f2fb8005250 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.942+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb00c6450 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2fb8005450 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 10 client.15648 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55778e128ac0 con 0x55778e0b2800 2024-04-25T20:52:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2fb00c6450 con 0x55778e0b2800 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7f2fb8033750 con 0x55778e0b2800 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 10 client.15648 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 20 client.15648 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e128f90 0x55778e12b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 4 client.15648 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55778e014200 con 0x55778e128f90 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.943+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e128f90 0x55778e12b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.944+0000 7f2fbf7fe640 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e128f90 0x55778e12b380 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c058f68520048e1 server_cookie=1f59a55d6f890756 in_seq=0 out_seq=0 2024-04-25T20:52:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:13.944+0000 7f2f9effd640 10 client.15648 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:13 smithi043 ceph-mon[29167]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 530 KiB/s wr, 173 op/s 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2f9effd640 1 -- 172.21.15.43:0/874223353 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55778e014200 con 0x55778e128f90 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2f9effd640 10 client.15648 handle_command_reply: tid=0 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 client.15648 shutdown 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 msgr2=0x55778e0b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2fb801d000 tx=0x7f2fb8009760 comp rx=0 tx=0).stop 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 shutdown_connections 2024-04-25T20:52:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55778e128f90 0x55778e12b380 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55778e0b2800 0x55778e0b6300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55778e0a7f40 0x55778e0b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2f9effd640 0 client.15648 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 --2- 172.21.15.43:0/874223353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55778e0a7620 0x55778e0ba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 >> 172.21.15.43:0/874223353 conn(0x55778e0a3b30 msgr2=0x55778e0a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 shutdown_connections 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 1 -- 172.21.15.43:0/874223353 wait complete. 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.065+0000 7f2fc8a35740 20 client.15648 trim_cache size 0 max 16384 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:52:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:52:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 msgr2=0x7f2fa80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 0x7f2fa80a6280 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fc01028e0 tx=0x7f2fb4006c90 comp rx=0 tx=0).stop 2024-04-25T20:52:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 msgr2=0x7f2fc0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0005e30 tx=0x7f2fb0003d60 comp rx=0 tx=0).stop 2024-04-25T20:52:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 shutdown_connections 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2fa80a3dc0 0x7f2fa80a6280 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fc010c540 0x7f2fc01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2fc0103b20 0x7f2fc0101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 --2- 172.21.15.43:0/790617079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fc0103200 0x7f2fc0100e50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 >> 172.21.15.43:0/790617079 conn(0x7f2fc0077fd0 msgr2=0x7f2fc00fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 shutdown_connections 2024-04-25T20:52:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:14.066+0000 7f2fc5c49640 1 -- 172.21.15.43:0/790617079 wait complete. 2024-04-25T20:52:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:13 smithi195 ceph-mon[33250]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 530 KiB/s wr, 173 op/s 2024-04-25T20:52:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:13 smithi112 ceph-mon[32322]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 530 KiB/s wr, 173 op/s 2024-04-25T20:52:15.818 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:52:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:15 smithi043 ceph-mon[29167]: pgmap v71: 97 pgs: 97 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 909 KiB/s wr, 219 op/s 2024-04-25T20:52:16.083 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:52:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:15 smithi195 ceph-mon[33250]: pgmap v71: 97 pgs: 97 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 909 KiB/s wr, 219 op/s 2024-04-25T20:52:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:15 smithi112 ceph-mon[32322]: pgmap v71: 97 pgs: 97 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 909 KiB/s wr, 219 op/s 2024-04-25T20:52:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:17 smithi043 ceph-mon[29167]: pgmap v72: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:18.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 -- 172.21.15.43:0/3412378429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c06bba0 msgr2=0x7fa03c10f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 --2- 172.21.15.43:0/3412378429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c06bba0 0x7fa03c10f8d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa03400b0d0 tx=0x7fa03400b3e0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 -- 172.21.15.43:0/3412378429 shutdown_connections 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 --2- 172.21.15.43:0/3412378429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c108a20 0x7fa03c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 --2- 172.21.15.43:0/3412378429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c06bba0 0x7fa03c10f8d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 --2- 172.21.15.43:0/3412378429 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06b1e0 0x7fa03c06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 -- 172.21.15.43:0/3412378429 >> 172.21.15.43:0/3412378429 conn(0x7fa03c0779b0 msgr2=0x7fa03c077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 -- 172.21.15.43:0/3412378429 shutdown_connections 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.049+0000 7fa041c2e700 1 -- 172.21.15.43:0/3412378429 wait complete. 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 Processor -- start 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 -- start start 2024-04-25T20:52:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c06b1e0 0x7fa03c101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06bba0 0x7fa03c101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c112d80 con 0x7fa03c108a20 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c112c00 con 0x7fa03c06bba0 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa041c2e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c112f00 con 0x7fa03c06b1e0 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa03bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa03bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33998/0 (socket says 172.21.15.43:33998) 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa03bfff700 1 -- 172.21.15.43:0/587347586 learned_addr learned my addr 172.21.15.43:0/587347586 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa03b7fe700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c06b1e0 0x7fa03c101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.050+0000 7fa03affd700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06bba0 0x7fa03c101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 -- 172.21.15.43:0/587347586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c06b1e0 msgr2=0x7fa03c101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c06b1e0 0x7fa03c101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 -- 172.21.15.43:0/587347586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06bba0 msgr2=0x7fa03c101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06bba0 0x7fa03c101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 -- 172.21.15.43:0/587347586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03c1a7640 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa03bfff700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa034007a20 tx=0x7fa034007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03401f070 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c1a78d0 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa034004c50 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03401b680 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.051+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c1a7d80 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.052+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03c1041a0 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.053+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa034022070 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.054+0000 7fa038ff9700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 0x7fa0240a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.054+0000 7fa03b7fe700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 0x7fa0240a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.054+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fa03400f020 con 0x7fa03c108a20 2024-04-25T20:52:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.054+0000 7fa03b7fe700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 0x7fa0240a6270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005950 tx=0x7fa02c00b410 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:18.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.058+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa034029020 con 0x7fa03c108a20 2024-04-25T20:52:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:17 smithi195 ceph-mon[33250]: pgmap v72: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:17 smithi112 ceph-mon[32322]: pgmap v72: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:18.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.315+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa03c02e140 con 0x7fa03c108a20 2024-04-25T20:52:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.316+0000 7fa038ff9700 1 -- 172.21.15.43:0/587347586 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11937 (secure 0 0 0) 0x7fa03409e110 con 0x7fa03c108a20 2024-04-25T20:52:18.317 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:52:18.317 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:51:57.370989+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24430,24424,24448,24470,24449]},"id":1}]} 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 msgr2=0x7fa0240a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 0x7fa0240a6270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa02c005950 tx=0x7fa02c00b410 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 msgr2=0x7fa03c1024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa034007a20 tx=0x7fa034007a50 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 shutdown_connections 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fa0240a3db0 0x7fa0240a6270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa03c06b1e0 0x7fa03c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa03c108a20 0x7fa03c1024c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 --2- 172.21.15.43:0/587347586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa03c06bba0 0x7fa03c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.318+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 >> 172.21.15.43:0/587347586 conn(0x7fa03c0779b0 msgr2=0x7fa03c100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.319+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 shutdown_connections 2024-04-25T20:52:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:18.319+0000 7fa041c2e700 1 -- 172.21.15.43:0/587347586 wait complete. 2024-04-25T20:52:18.320 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 29 2024-04-25T20:52:18.994 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:18 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/587347586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:52:19.042 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:18 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/587347586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:52:19.069 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24470 quiesce db --set-id ae7ddaac --release --await' 2024-04-25T20:52:19.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24470 quiesce db --set-id ae7ddaac --release --await 2024-04-25T20:52:19.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:18 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/587347586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:52:19.323 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:52:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:19 smithi043 ceph-mon[29167]: pgmap v73: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:20.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:19 smithi195 ceph-mon[33250]: pgmap v73: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:19 smithi112 ceph-mon[32322]: pgmap v73: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 817 KiB/s wr, 169 op/s 2024-04-25T20:52:21.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/3218224698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0101970 msgr2=0x7fb1c0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/3218224698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0101970 0x7fb1c0101df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009990 tx=0x7fb1b4009ca0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/3218224698 shutdown_connections 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/3218224698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 0x7fb1c0107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/3218224698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0102330 0x7fb1c010e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/3218224698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0101970 0x7fb1c0101df0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/3218224698 >> 172.21.15.43:0/3218224698 conn(0x7fb1c00788f0 msgr2=0x7fb1c0078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/3218224698 shutdown_connections 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/3218224698 wait complete. 2024-04-25T20:52:21.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.186+0000 7fb1c5ca4700 1 Processor -- start 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 -- start start 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0101970 0x7fb1c01034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 0x7fb1c0103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111c80 con 0x7fb1c0102330 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111b00 con 0x7fb1c0101970 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1c5ca4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111e00 con 0x7fb1c0107920 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34018/0 (socket says 172.21.15.43:34018) 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 -- 172.21.15.43:0/2732136684 learned_addr learned my addr 172.21.15.43:0/2732136684 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0101970 0x7fb1c01034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1bffff700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 0x7fb1c0103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 -- 172.21.15.43:0/2732136684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 msgr2=0x7fb1c0103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 0x7fb1c0103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 -- 172.21.15.43:0/2732136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0101970 msgr2=0x7fb1c01034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0101970 0x7fb1c01034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 -- 172.21.15.43:0/2732136684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c01a7650 con 0x7fb1c0102330 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.187+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009fb0 tx=0x7fb1b4005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.188+0000 7fb1bcff9700 1 -- 172.21.15.43:0/2732136684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4027070 con 0x7fb1c0102330 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.188+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c01a78e0 con 0x7fb1c0102330 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.188+0000 7fb1bcff9700 1 -- 172.21.15.43:0/2732136684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b4004030 con 0x7fb1c0102330 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.188+0000 7fb1bcff9700 1 -- 172.21.15.43:0/2732136684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4022d60 con 0x7fb1c0102330 2024-04-25T20:52:21.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.188+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c01a7dc0 con 0x7fb1c0102330 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.190+0000 7fb1bcff9700 1 -- 172.21.15.43:0/2732136684 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fb1b402a070 con 0x7fb1c0102330 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.190+0000 7fb1bcff9700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 0x7fb1a80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.191+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 0x7fb1a80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.191+0000 7fb1bcff9700 1 -- 172.21.15.43:0/2732136684 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb1b40d1680 con 0x7fb1c0102330 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.191+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 0x7fb1a80a6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000abd0 tx=0x7fb1b000a380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.191+0000 7fb1d052db80 1 Processor -- start 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.191+0000 7fb1d052db80 1 -- start start 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533c9f0 0x55d2c533cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c53481e0 0x55d2c534a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d2c528fe30 con 0x55d2c533d310 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d2c5236a60 con 0x55d2c533c9f0 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1d052db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d2c528bdf0 con 0x55d2c53481e0 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34022/0 (socket says 172.21.15.43:34022) 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 -- 172.21.15.43:0/2607210743 learned_addr learned my addr 172.21.15.43:0/2607210743 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533c9f0 0x55d2c533cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 -- 172.21.15.43:0/2607210743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c53481e0 msgr2=0x55d2c534a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c53481e0 0x55d2c534a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 -- 172.21.15.43:0/2607210743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533c9f0 msgr2=0x55d2c533cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533c9f0 0x55d2c533cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 -- 172.21.15.43:0/2607210743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c51dd9d0 con 0x55d2c533d310 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4099b40 tx=0x7fb1b4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67792e45ebb6e49e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1a5ffb700 1 -- 172.21.15.43:0/2607210743 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40880e0 con 0x55d2c533d310 2024-04-25T20:52:21.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1a5ffb700 1 -- 172.21.15.43:0/2607210743 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b409dde0 con 0x55d2c533d310 2024-04-25T20:52:21.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.192+0000 7fb1a5ffb700 1 -- 172.21.15.43:0/2607210743 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b409d940 con 0x55d2c533d310 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 -- 172.21.15.43:0/2607210743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 msgr2=0x55d2c5347ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4099b40 tx=0x7fb1b4005a00 comp rx=0 tx=0).stop 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 -- 172.21.15.43:0/2607210743 shutdown_connections 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c53481e0 0x55d2c534a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533c9f0 0x55d2c533cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2607210743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5347ca0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 -- 172.21.15.43:0/2607210743 >> 172.21.15.43:0/2607210743 conn(0x55d2c526a790 msgr2=0x55d2c5338ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 -- 172.21.15.43:0/2607210743 shutdown_connections 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.193+0000 7fb1d052db80 1 -- 172.21.15.43:0/2607210743 wait complete. 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 -- start start 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 Processor -- start 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c5347a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c5345240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d2c528fe30 con 0x55d2c533d310 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d2c522ecd0 con 0x55d2c53481e0 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55d2c534ab10 con 0x55d2c533c9f0 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1d052db80 10 client.0 _ll_register_callbacks cb 0x55d2c5228a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34030/0 (socket says 172.21.15.43:34030) 2024-04-25T20:52:21.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1beffd700 1 -- 172.21.15.43:0/2492771405 learned_addr learned my addr 172.21.15.43:0/2492771405 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c5347a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.194+0000 7fb1bffff700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c5345240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 -- 172.21.15.43:0/2492771405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 msgr2=0x55d2c5347a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c5347a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 -- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 msgr2=0x55d2c5345240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c5345240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 -- 172.21.15.43:0/2492771405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c5247370 con 0x55d2c533d310 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c5347a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1bffff700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c5345240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1beffd700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cf380 tx=0x7fb1b40ced70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2270f24d40a417e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b409db40 con 0x55d2c533d310 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb1b40a5e30 con 0x55d2c533d310 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1b409dde0 con 0x55d2c533d310 2024-04-25T20:52:21.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb1b40a1a90 con 0x55d2c533d310 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1d052db80 10 client.15666 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2c5355210 con 0x55d2c533d310 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b409dde0 con 0x55d2c533d310 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.195+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fb1b40bc2b0 con 0x55d2c533d310 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 10 client.15666 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 10 client.15666 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 20 client.15666 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53576e0 0x55d2c5359ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 4 client.15666 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2c529d620 con 0x55d2c53576e0 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53576e0 0x55d2c5359ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb19effd700 10 client.15666 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.196+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53576e0 0x55d2c5359ad0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2e8c09771fc2fe server_cookie=b06df8d3c6212b72 in_seq=0 out_seq=0 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb19effd700 1 -- 172.21.15.43:0/2492771405 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d2c529d620 con 0x55d2c53576e0 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb19effd700 10 client.15666 handle_command_reply: tid=0 2024-04-25T20:52:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 client.15666 shutdown 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 msgr2=0x55d2c5344d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40cf380 tx=0x7fb1b40ced70 comp rx=0 tx=0).stop 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 shutdown_connections 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53576e0 0x55d2c5359ad0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c5347a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c5345240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 --2- 172.21.15.43:0/2492771405 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5344d00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 >> 172.21.15.43:0/2492771405 conn(0x55d2c526a790 msgr2=0x55d2c5338b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb19effd700 0 client.15666 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 shutdown_connections 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.197+0000 7fb1d052db80 1 -- 172.21.15.43:0/2492771405 wait complete. 2024-04-25T20:52:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.198+0000 7fb1d052db80 20 client.15666 trim_cache size 0 max 16384 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.217+0000 7fb1d052db80 1 Processor -- start 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.217+0000 7fb1d052db80 1 -- start start 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.217+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c53404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.217+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.217+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c53537c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1d052db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01af450 con 0x55d2c533d310 2024-04-25T20:52:21.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1d052db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01b0fc0 con 0x55d2c53481e0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1d052db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01afb20 con 0x55d2c533c9f0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34032/0 (socket says 172.21.15.43:34032) 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 -- 172.21.15.43:0/3411810540 learned_addr learned my addr 172.21.15.43:0/3411810540 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c53404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 -- 172.21.15.43:0/3411810540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 msgr2=0x55d2c53404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1bffff700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c53537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c53404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 -- 172.21.15.43:0/3411810540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 msgr2=0x55d2c53537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c53537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 -- 172.21.15.43:0/3411810540 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c533e3b0 con 0x55d2c533d310 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1bffff700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c53537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1beffd700 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb1b409d3e0 tx=0x7fb1b4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3beb3c97b2020cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1a57fa700 1 -- 172.21.15.43:0/3411810540 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b409d040 con 0x55d2c533d310 2024-04-25T20:52:21.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1a57fa700 1 -- 172.21.15.43:0/3411810540 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b409dde0 con 0x55d2c533d310 2024-04-25T20:52:21.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.218+0000 7fb1a57fa700 1 -- 172.21.15.43:0/3411810540 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5e30 con 0x55d2c533d310 2024-04-25T20:52:21.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- 172.21.15.43:0/3411810540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 msgr2=0x55d2c5343d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb1b409d3e0 tx=0x7fb1b4009310 comp rx=0 tx=0).stop 2024-04-25T20:52:21.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- 172.21.15.43:0/3411810540 shutdown_connections 2024-04-25T20:52:21.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c53404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c53481e0 0x55d2c53537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 --2- 172.21.15.43:0/3411810540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c533d310 0x55d2c5343d40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- 172.21.15.43:0/3411810540 >> 172.21.15.43:0/3411810540 conn(0x55d2c526a790 msgr2=0x55d2c5343630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- 172.21.15.43:0/3411810540 shutdown_connections 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- 172.21.15.43:0/3411810540 wait complete. 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.219+0000 7fb1d052db80 1 -- start start 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 Processor -- start 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c534ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533d310 0x55d2c534c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01b08c0 con 0x55d2c53481e0 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01b01f0 con 0x55d2c533d310 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c01ad3f0 con 0x55d2c533c9f0 2024-04-25T20:52:21.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1d052db80 10 client.0 _ll_register_callbacks cb 0x55d2c5228a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34048/0 (socket says 172.21.15.43:34048) 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 -- 172.21.15.43:0/1694487187 learned_addr learned my addr 172.21.15.43:0/1694487187 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1beffd700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533d310 0x55d2c534c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c534ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 -- 172.21.15.43:0/1694487187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 msgr2=0x55d2c534ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c534ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 -- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533d310 msgr2=0x55d2c534c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533d310 0x55d2c534c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.220+0000 7fb1bffff700 1 -- 172.21.15.43:0/1694487187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c534cf40 con 0x55d2c53481e0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1bffff700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8011890 tx=0x7fb1b8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc30eb2fee8160b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8010040 con 0x55d2c53481e0 2024-04-25T20:52:21.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1b409dde0 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fb1b8003c00 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb1b8003e00 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 10 client.15672 fetch_fsmap learned FSMap version 29 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2c53bea30 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb1b409dde0 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7fb1b80043e0 con 0x55d2c53481e0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 10 client.15672 fetch_fsmap finished waiting for FSMap version 29 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 10 client.15672 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 20 client.15672 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53bf150 0x55d2c53c1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 4 client.15672 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ae7ddaac", "release": true, "await": true}] 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.221+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ae7ddaac", "release": true, "await": true}) -- 0x55d2c52976c0 con 0x55d2c53bf150 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.222+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53bf150 0x55d2c53c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:21.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.222+0000 7fb19effd700 10 client.15672 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:21.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.222+0000 7fb1bf7fe700 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53bf150 0x55d2c53c1570 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2107e55c9a8fa6 server_cookie=9820b52eb62dd42d in_seq=0 out_seq=0 2024-04-25T20:52:21.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb19effd700 1 -- 172.21.15.43:0/1694487187 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d2c52976c0 con 0x55d2c53bf150 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb19effd700 10 client.15672 handle_command_reply: tid=0 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 client.15672 shutdown 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 msgr2=0x55d2c534c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8011890 tx=0x7fb1b8011ba0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 shutdown_connections 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55d2c53bf150 0x55d2c53c1570 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d2c533c9f0 0x55d2c534ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d2c53481e0 0x55d2c534c840 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 --2- 172.21.15.43:0/1694487187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2c533d310 0x55d2c534c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 >> 172.21.15.43:0/1694487187 conn(0x55d2c526a790 msgr2=0x55d2c5343d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb19effd700 0 client.15672 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 shutdown_connections 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 1 -- 172.21.15.43:0/1694487187 wait complete. 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.361+0000 7fb1d052db80 20 client.15672 trim_cache size 0 max 16384 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 29, 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stdout: "leader": 24470, 2024-04-25T20:52:21.363 INFO:teuthology.orchestra.run.smithi043.stdout: "set_version": 8, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "sets": { 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "ae7ddaac": { 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "version": 8, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "age_ref": 0.0, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RELEASED", 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "timeout": 60.0, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "expiration": 86.2, 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "members": { 2024-04-25T20:52:21.364 INFO:teuthology.orchestra.run.smithi043.stdout: "file:/": { 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: "excluded": false, 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: "state": { 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RELEASED", 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T20:52:21.365 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:52:21.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-04-25T20:52:21.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 msgr2=0x7fb1a80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 0x7fb1a80a6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000abd0 tx=0x7fb1b000a380 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 msgr2=0x7fb1c0103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009fb0 tx=0x7fb1b4005590 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 shutdown_connections 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fb1a80a3db0 0x7fb1a80a6270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c0107920 0x7fb1c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb1c0101970 0x7fb1c01034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 --2- 172.21.15.43:0/2732136684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c0102330 0x7fb1c0103a30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 >> 172.21.15.43:0/2732136684 conn(0x7fb1c00788f0 msgr2=0x7fb1c006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 shutdown_connections 2024-04-25T20:52:21.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:52:21.362+0000 7fb1c5ca4700 1 -- 172.21.15.43:0/2732136684 wait complete. 2024-04-25T20:52:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-04-25T20:52:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-04-25T20:52:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-04-25T20:52:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-04-25T20:52:21.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-04-25T20:52:21.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-04-25T20:52:21.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-04-25T20:52:21.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-04-25T20:52:21.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-04-25T20:52:21.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-04-25T20:52:21.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-04-25T20:52:21.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-04-25T20:52:21.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-04-25T20:52:21.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-04-25T20:52:21.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-04-25T20:52:21.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-04-25T20:52:21.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-04-25T20:52:21.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-04-25T20:52:21.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-04-25T20:52:21.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-04-25T20:52:21.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-04-25T20:52:21.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-04-25T20:52:21.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-04-25T20:52:21.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-04-25T20:52:21.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-04-25T20:52:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-04-25T20:52:21.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-04-25T20:52:21.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-04-25T20:52:21.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-04-25T20:52:21.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-04-25T20:52:21.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-04-25T20:52:21.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-04-25T20:52:21.412 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-04-25T20:52:21.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-04-25T20:52:21.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-04-25T20:52:21.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-04-25T20:52:21.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-04-25T20:52:21.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-04-25T20:52:21.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-04-25T20:52:21.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-04-25T20:52:21.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-04-25T20:52:21.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-04-25T20:52:21.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-04-25T20:52:21.436 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-04-25T20:52:21.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-04-25T20:52:21.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-04-25T20:52:21.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-04-25T20:52:21.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-04-25T20:52:21.444 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-04-25T20:52:21.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-04-25T20:52:21.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-04-25T20:52:21.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-04-25T20:52:21.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-04-25T20:52:21.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-04-25T20:52:21.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-04-25T20:52:21.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-04-25T20:52:21.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-04-25T20:52:21.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-04-25T20:52:21.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-04-25T20:52:21.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-04-25T20:52:21.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-04-25T20:52:21.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-04-25T20:52:21.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-04-25T20:52:21.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-04-25T20:52:21.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-04-25T20:52:21.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-04-25T20:52:21.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-04-25T20:52:21.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-04-25T20:52:21.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-04-25T20:52:21.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-04-25T20:52:21.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-04-25T20:52:21.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-04-25T20:52:21.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-04-25T20:52:21.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-04-25T20:52:21.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-04-25T20:52:21.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-04-25T20:52:21.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-04-25T20:52:21.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-04-25T20:52:21.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-04-25T20:52:21.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-04-25T20:52:21.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-04-25T20:52:21.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-04-25T20:52:21.537 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-04-25T20:52:21.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-04-25T20:52:21.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-04-25T20:52:21.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-04-25T20:52:21.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-04-25T20:52:21.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-04-25T20:52:21.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-04-25T20:52:21.551 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-04-25T20:52:21.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-04-25T20:52:21.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-04-25T20:52:21.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-04-25T20:52:21.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-04-25T20:52:21.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-04-25T20:52:21.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-04-25T20:52:21.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-04-25T20:52:21.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-04-25T20:52:21.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-04-25T20:52:21.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-04-25T20:52:21.569 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-04-25T20:52:21.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-04-25T20:52:21.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-04-25T20:52:21.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-04-25T20:52:21.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-04-25T20:52:21.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-04-25T20:52:21.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-04-25T20:52:21.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-04-25T20:52:21.581 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-04-25T20:52:21.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-04-25T20:52:21.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-04-25T20:52:21.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-04-25T20:52:21.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-04-25T20:52:21.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-04-25T20:52:21.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-04-25T20:52:21.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-04-25T20:52:21.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-04-25T20:52:21.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-04-25T20:52:21.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-04-25T20:52:21.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-04-25T20:52:21.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-04-25T20:52:21.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-04-25T20:52:21.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-04-25T20:52:21.614 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-04-25T20:52:21.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-04-25T20:52:21.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-04-25T20:52:21.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-04-25T20:52:21.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-04-25T20:52:21.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-04-25T20:52:21.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-04-25T20:52:21.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-04-25T20:52:21.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-04-25T20:52:21.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-04-25T20:52:21.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-04-25T20:52:21.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-04-25T20:52:21.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-04-25T20:52:21.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-04-25T20:52:21.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-04-25T20:52:21.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-04-25T20:52:21.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-04-25T20:52:21.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-04-25T20:52:21.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-04-25T20:52:21.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-04-25T20:52:21.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-04-25T20:52:21.649 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-04-25T20:52:21.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-04-25T20:52:21.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-04-25T20:52:21.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-04-25T20:52:21.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-04-25T20:52:21.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-04-25T20:52:21.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-04-25T20:52:21.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-04-25T20:52:21.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-04-25T20:52:21.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-04-25T20:52:21.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-04-25T20:52:21.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-04-25T20:52:21.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-04-25T20:52:21.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-04-25T20:52:21.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-04-25T20:52:21.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-04-25T20:52:21.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-04-25T20:52:21.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-04-25T20:52:21.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-04-25T20:52:21.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-04-25T20:52:21.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-04-25T20:52:21.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-04-25T20:52:21.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-04-25T20:52:21.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-04-25T20:52:21.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-04-25T20:52:21.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-04-25T20:52:21.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-04-25T20:52:21.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-04-25T20:52:21.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-04-25T20:52:21.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-04-25T20:52:21.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-04-25T20:52:21.689 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-04-25T20:52:21.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-04-25T20:52:21.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-04-25T20:52:21.693 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-04-25T20:52:21.696 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-04-25T20:52:21.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-04-25T20:52:21.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-04-25T20:52:21.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-04-25T20:52:21.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-04-25T20:52:21.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-04-25T20:52:21.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-04-25T20:52:21.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-04-25T20:52:21.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-04-25T20:52:21.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-04-25T20:52:21.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-04-25T20:52:21.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-04-25T20:52:21.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-04-25T20:52:21.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-04-25T20:52:21.720 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-04-25T20:52:21.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-04-25T20:52:21.723 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-04-25T20:52:21.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-04-25T20:52:21.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-04-25T20:52:21.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-04-25T20:52:21.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-04-25T20:52:21.734 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-04-25T20:52:21.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-04-25T20:52:21.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-04-25T20:52:21.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-04-25T20:52:21.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-04-25T20:52:21.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-04-25T20:52:21.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-04-25T20:52:21.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-04-25T20:52:21.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-04-25T20:52:21.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-04-25T20:52:21.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-04-25T20:52:21.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-04-25T20:52:21.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-04-25T20:52:21.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-04-25T20:52:21.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-04-25T20:52:21.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-04-25T20:52:21.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-04-25T20:52:21.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-04-25T20:52:21.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-04-25T20:52:21.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-04-25T20:52:21.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-04-25T20:52:21.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-04-25T20:52:21.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-04-25T20:52:21.773 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-04-25T20:52:21.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-04-25T20:52:21.776 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-04-25T20:52:21.778 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-04-25T20:52:21.779 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-04-25T20:52:21.781 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-04-25T20:52:21.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-04-25T20:52:21.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-04-25T20:52:21.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-04-25T20:52:21.788 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-04-25T20:52:21.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-04-25T20:52:21.792 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-04-25T20:52:21.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-04-25T20:52:21.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-04-25T20:52:21.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-04-25T20:52:21.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-04-25T20:52:21.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-04-25T20:52:21.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-04-25T20:52:21.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-04-25T20:52:21.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-04-25T20:52:21.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-04-25T20:52:21.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-04-25T20:52:21.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-04-25T20:52:21.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-04-25T20:52:21.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-04-25T20:52:21.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-04-25T20:52:21.819 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-04-25T20:52:21.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-04-25T20:52:21.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-04-25T20:52:21.824 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-04-25T20:52:21.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-04-25T20:52:21.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-04-25T20:52:21.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-04-25T20:52:21.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-04-25T20:52:21.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-04-25T20:52:21.833 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-04-25T20:52:21.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-04-25T20:52:21.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-04-25T20:52:21.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-04-25T20:52:21.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-04-25T20:52:21.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-04-25T20:52:21.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-04-25T20:52:21.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-04-25T20:52:21.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-04-25T20:52:21.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-04-25T20:52:21.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-04-25T20:52:21.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-04-25T20:52:21.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-04-25T20:52:21.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-04-25T20:52:21.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-04-25T20:52:21.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-04-25T20:52:21.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-04-25T20:52:21.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-04-25T20:52:21.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-04-25T20:52:21.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-04-25T20:52:21.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-04-25T20:52:21.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-04-25T20:52:21.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-04-25T20:52:21.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-04-25T20:52:21.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-04-25T20:52:21.859 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-04-25T20:52:21.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-04-25T20:52:21.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-04-25T20:52:21.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-04-25T20:52:21.864 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-04-25T20:52:21.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-04-25T20:52:21.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-04-25T20:52:21.867 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-04-25T20:52:21.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-04-25T20:52:21.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-04-25T20:52:21.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-04-25T20:52:21.871 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-04-25T20:52:21.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-04-25T20:52:21.873 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-04-25T20:52:21.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-04-25T20:52:21.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-04-25T20:52:21.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-04-25T20:52:21.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-04-25T20:52:21.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-04-25T20:52:21.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-04-25T20:52:21.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-04-25T20:52:21.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-04-25T20:52:21.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-04-25T20:52:21.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-04-25T20:52:21.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-04-25T20:52:21.885 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-04-25T20:52:21.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-04-25T20:52:21.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-04-25T20:52:21.889 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-04-25T20:52:21.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-04-25T20:52:21.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-04-25T20:52:21.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-04-25T20:52:21.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-04-25T20:52:21.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-04-25T20:52:21.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-04-25T20:52:21.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-04-25T20:52:21.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-04-25T20:52:21.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-04-25T20:52:21.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-04-25T20:52:21.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-04-25T20:52:21.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-04-25T20:52:21.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-04-25T20:52:21.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-04-25T20:52:21.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-04-25T20:52:21.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-04-25T20:52:21.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-04-25T20:52:21.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-04-25T20:52:21.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-04-25T20:52:21.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-04-25T20:52:21.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-04-25T20:52:21.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-04-25T20:52:21.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-04-25T20:52:21.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-04-25T20:52:21.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-04-25T20:52:21.919 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-04-25T20:52:21.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-04-25T20:52:21.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-04-25T20:52:21.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-04-25T20:52:21.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-04-25T20:52:21.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-04-25T20:52:21.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-04-25T20:52:21.929 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-04-25T20:52:21.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-04-25T20:52:21.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-04-25T20:52:21.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-04-25T20:52:21.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-04-25T20:52:21.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-04-25T20:52:21.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-04-25T20:52:21.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-04-25T20:52:21.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-04-25T20:52:21.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-04-25T20:52:21.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-04-25T20:52:21.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-04-25T20:52:21.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-04-25T20:52:21.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-04-25T20:52:21.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-04-25T20:52:21.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-04-25T20:52:21.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-04-25T20:52:21.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-04-25T20:52:21.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-04-25T20:52:21.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-04-25T20:52:21.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-04-25T20:52:21.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-04-25T20:52:21.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-04-25T20:52:21.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-04-25T20:52:21.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-04-25T20:52:21.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-04-25T20:52:21.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-04-25T20:52:21.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-04-25T20:52:21.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-04-25T20:52:21.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-04-25T20:52:21.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-04-25T20:52:21.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-04-25T20:52:21.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-04-25T20:52:21.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-04-25T20:52:21.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-04-25T20:52:21.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-04-25T20:52:21.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-04-25T20:52:21.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-04-25T20:52:21.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-04-25T20:52:21.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-04-25T20:52:21.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-04-25T20:52:21.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-04-25T20:52:21.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-04-25T20:52:21.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-04-25T20:52:21.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-04-25T20:52:21.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-04-25T20:52:21.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-04-25T20:52:21.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-04-25T20:52:21.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-04-25T20:52:21.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-04-25T20:52:21.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-04-25T20:52:21.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-04-25T20:52:21.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-04-25T20:52:21.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-04-25T20:52:21.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-04-25T20:52:21.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-04-25T20:52:21.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-04-25T20:52:21.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-04-25T20:52:22.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-04-25T20:52:22.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-04-25T20:52:22.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-04-25T20:52:22.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-04-25T20:52:22.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-04-25T20:52:22.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-04-25T20:52:22.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-04-25T20:52:22.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-04-25T20:52:22.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-04-25T20:52:22.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-04-25T20:52:22.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-04-25T20:52:22.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-04-25T20:52:22.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-04-25T20:52:22.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-04-25T20:52:22.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-04-25T20:52:22.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-04-25T20:52:22.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-04-25T20:52:22.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-04-25T20:52:22.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-04-25T20:52:22.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-04-25T20:52:22.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-04-25T20:52:22.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-04-25T20:52:22.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-04-25T20:52:22.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-04-25T20:52:22.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-04-25T20:52:22.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-04-25T20:52:22.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-04-25T20:52:22.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-04-25T20:52:22.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-04-25T20:52:22.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-04-25T20:52:22.032 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-04-25T20:52:22.033 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-04-25T20:52:22.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-04-25T20:52:22.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-04-25T20:52:22.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-04-25T20:52:22.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-04-25T20:52:22.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-04-25T20:52:22.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-04-25T20:52:22.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-04-25T20:52:22.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-04-25T20:52:22.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-04-25T20:52:22.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-04-25T20:52:22.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-04-25T20:52:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:21 smithi043 ceph-mon[29167]: pgmap v74: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 819 KiB/s wr, 173 op/s 2024-04-25T20:52:22.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-04-25T20:52:22.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-04-25T20:52:22.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-04-25T20:52:22.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-04-25T20:52:22.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-04-25T20:52:22.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-04-25T20:52:22.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-04-25T20:52:22.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-04-25T20:52:22.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-04-25T20:52:22.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-04-25T20:52:22.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-04-25T20:52:22.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-04-25T20:52:22.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-04-25T20:52:22.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-04-25T20:52:22.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-04-25T20:52:22.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-04-25T20:52:22.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-04-25T20:52:22.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-04-25T20:52:22.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-04-25T20:52:22.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-04-25T20:52:22.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-04-25T20:52:22.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-04-25T20:52:22.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-04-25T20:52:22.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-04-25T20:52:22.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-04-25T20:52:22.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-04-25T20:52:22.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-04-25T20:52:22.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-04-25T20:52:22.074 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-04-25T20:52:22.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-04-25T20:52:22.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-04-25T20:52:22.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-04-25T20:52:22.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-04-25T20:52:22.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-04-25T20:52:22.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-04-25T20:52:22.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-04-25T20:52:22.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-04-25T20:52:22.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-04-25T20:52:22.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-04-25T20:52:22.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-04-25T20:52:22.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-04-25T20:52:22.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-04-25T20:52:22.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-04-25T20:52:22.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-04-25T20:52:22.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-04-25T20:52:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:21 smithi195 ceph-mon[33250]: pgmap v74: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 819 KiB/s wr, 173 op/s 2024-04-25T20:52:22.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-04-25T20:52:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:21 smithi112 ceph-mon[32322]: pgmap v74: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 819 KiB/s wr, 173 op/s 2024-04-25T20:52:22.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-04-25T20:52:22.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-04-25T20:52:22.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-04-25T20:52:22.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-04-25T20:52:22.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-04-25T20:52:22.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-04-25T20:52:22.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-04-25T20:52:22.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-04-25T20:52:22.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-04-25T20:52:22.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-04-25T20:52:22.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-04-25T20:52:22.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-04-25T20:52:22.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-04-25T20:52:22.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-04-25T20:52:22.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-04-25T20:52:22.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-04-25T20:52:22.108 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-04-25T20:52:22.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-04-25T20:52:22.110 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-04-25T20:52:22.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-04-25T20:52:22.112 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-04-25T20:52:22.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-04-25T20:52:22.114 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-04-25T20:52:22.115 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-04-25T20:52:22.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-04-25T20:52:22.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-04-25T20:52:22.118 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-04-25T20:52:22.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-04-25T20:52:22.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-04-25T20:52:22.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-04-25T20:52:22.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-04-25T20:52:22.123 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-04-25T20:52:22.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-04-25T20:52:22.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-04-25T20:52:22.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-04-25T20:52:22.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-04-25T20:52:22.130 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-04-25T20:52:22.130 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-04-25T20:52:22.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-04-25T20:52:22.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-04-25T20:52:22.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-04-25T20:52:22.135 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-04-25T20:52:22.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-04-25T20:52:22.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-04-25T20:52:22.138 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-04-25T20:52:22.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-04-25T20:52:22.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-04-25T20:52:22.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-04-25T20:52:22.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-04-25T20:52:22.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-04-25T20:52:22.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-04-25T20:52:22.144 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-04-25T20:52:22.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-04-25T20:52:22.147 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-04-25T20:52:22.148 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-04-25T20:52:22.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-04-25T20:52:22.150 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-04-25T20:52:22.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-04-25T20:52:22.152 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-04-25T20:52:22.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-04-25T20:52:22.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-04-25T20:52:22.155 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-04-25T20:52:22.156 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-04-25T20:52:22.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-04-25T20:52:22.158 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-04-25T20:52:22.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-04-25T20:52:22.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-04-25T20:52:22.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-04-25T20:52:22.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-04-25T20:52:22.163 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-04-25T20:52:22.165 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-04-25T20:52:22.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-04-25T20:52:22.167 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-04-25T20:52:22.168 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-04-25T20:52:22.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-04-25T20:52:22.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-04-25T20:52:22.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-04-25T20:52:22.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-04-25T20:52:22.173 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/digsig.txt 2024-04-25T20:52:22.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-04-25T20:52:22.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-04-25T20:52:22.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-04-25T20:52:22.177 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-04-25T20:52:22.178 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-04-25T20:52:22.179 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-04-25T20:52:22.180 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dontdiff 2024-04-25T20:52:22.181 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/ 2024-04-25T20:52:22.183 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-04-25T20:52:22.184 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-04-25T20:52:22.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-04-25T20:52:22.185 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-04-25T20:52:22.186 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-04-25T20:52:22.187 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-04-25T20:52:22.188 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-04-25T20:52:22.189 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-04-25T20:52:22.190 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-04-25T20:52:22.191 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-04-25T20:52:22.192 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ 2024-04-25T20:52:22.193 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-04-25T20:52:22.194 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-04-25T20:52:22.195 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-04-25T20:52:22.196 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-04-25T20:52:22.197 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-04-25T20:52:22.198 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-04-25T20:52:22.199 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-04-25T20:52:22.199 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-04-25T20:52:22.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-04-25T20:52:22.201 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-04-25T20:52:22.202 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-04-25T20:52:22.203 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-04-25T20:52:22.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-04-25T20:52:22.205 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-04-25T20:52:22.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-04-25T20:52:22.207 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-04-25T20:52:22.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-04-25T20:52:22.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-04-25T20:52:22.211 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/edac.txt 2024-04-25T20:52:22.212 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-04-25T20:52:22.213 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/eisa.txt 2024-04-25T20:52:22.214 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-04-25T20:52:22.215 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/extcon/ 2024-04-25T20:52:22.216 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-04-25T20:52:22.217 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-04-25T20:52:22.219 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-04-25T20:52:22.220 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-04-25T20:52:22.221 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-04-25T20:52:22.222 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/ 2024-04-25T20:52:22.223 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-04-25T20:52:22.224 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-04-25T20:52:22.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-04-25T20:52:22.226 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-04-25T20:52:22.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-04-25T20:52:22.228 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-04-25T20:52:22.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-04-25T20:52:22.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-04-25T20:52:22.231 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-04-25T20:52:22.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-04-25T20:52:22.233 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-04-25T20:52:22.234 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-04-25T20:52:22.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-04-25T20:52:22.236 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-04-25T20:52:22.237 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-04-25T20:52:22.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-04-25T20:52:22.239 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-04-25T20:52:22.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-04-25T20:52:22.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-04-25T20:52:22.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-04-25T20:52:22.243 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-04-25T20:52:22.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-04-25T20:52:22.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-04-25T20:52:22.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-04-25T20:52:22.247 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-04-25T20:52:22.248 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-04-25T20:52:22.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-04-25T20:52:22.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-04-25T20:52:22.251 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-04-25T20:52:22.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-04-25T20:52:22.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-04-25T20:52:22.254 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-04-25T20:52:22.254 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-04-25T20:52:22.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-04-25T20:52:22.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-04-25T20:52:22.257 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ 2024-04-25T20:52:22.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-04-25T20:52:22.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-04-25T20:52:22.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-04-25T20:52:22.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-04-25T20:52:22.262 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-04-25T20:52:22.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-04-25T20:52:22.264 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-04-25T20:52:22.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-04-25T20:52:22.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-04-25T20:52:22.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-04-25T20:52:22.268 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-04-25T20:52:22.269 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-04-25T20:52:22.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-04-25T20:52:22.271 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-04-25T20:52:22.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-04-25T20:52:22.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-04-25T20:52:22.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-04-25T20:52:22.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-04-25T20:52:22.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-04-25T20:52:22.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-04-25T20:52:22.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-04-25T20:52:22.279 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-04-25T20:52:22.280 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-04-25T20:52:22.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-04-25T20:52:22.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-04-25T20:52:22.283 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-04-25T20:52:22.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-04-25T20:52:22.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-04-25T20:52:22.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-04-25T20:52:22.287 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-04-25T20:52:22.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-04-25T20:52:22.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-04-25T20:52:22.290 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-04-25T20:52:22.291 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-04-25T20:52:22.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-04-25T20:52:22.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-04-25T20:52:22.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-04-25T20:52:22.295 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-04-25T20:52:22.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-04-25T20:52:22.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-04-25T20:52:22.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-04-25T20:52:22.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-04-25T20:52:22.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-04-25T20:52:22.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-04-25T20:52:22.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-04-25T20:52:22.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-04-25T20:52:22.304 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-04-25T20:52:22.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-04-25T20:52:22.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-04-25T20:52:22.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-04-25T20:52:22.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-04-25T20:52:22.309 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-04-25T20:52:22.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-04-25T20:52:22.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-04-25T20:52:22.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-04-25T20:52:22.313 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-04-25T20:52:22.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-04-25T20:52:22.315 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-04-25T20:52:22.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-04-25T20:52:22.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-04-25T20:52:22.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-04-25T20:52:22.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-04-25T20:52:22.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-04-25T20:52:22.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-04-25T20:52:22.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-04-25T20:52:22.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-04-25T20:52:22.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-04-25T20:52:22.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-04-25T20:52:22.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-04-25T20:52:22.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-04-25T20:52:22.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-04-25T20:52:22.327 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-04-25T20:52:22.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-04-25T20:52:22.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-04-25T20:52:22.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-04-25T20:52:22.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-04-25T20:52:22.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-04-25T20:52:22.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-04-25T20:52:22.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-04-25T20:52:22.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-04-25T20:52:22.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-04-25T20:52:22.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-04-25T20:52:22.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-04-25T20:52:22.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-04-25T20:52:22.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-04-25T20:52:22.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-04-25T20:52:22.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-04-25T20:52:22.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-04-25T20:52:22.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-04-25T20:52:22.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-04-25T20:52:22.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-04-25T20:52:22.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-04-25T20:52:22.345 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ae7ddaac', seconds elapsed: 43.7 2024-04-25T20:52:22.345 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-04-25T20:52:22.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-04-25T20:52:22.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-04-25T20:52:22.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-04-25T20:52:22.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-04-25T20:52:22.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-04-25T20:52:22.351 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-04-25T20:52:22.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-04-25T20:52:22.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-04-25T20:52:22.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-04-25T20:52:22.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-04-25T20:52:22.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-04-25T20:52:22.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-04-25T20:52:22.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-04-25T20:52:22.358 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-04-25T20:52:22.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-04-25T20:52:22.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-04-25T20:52:22.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-04-25T20:52:22.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-04-25T20:52:22.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-04-25T20:52:22.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-04-25T20:52:22.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-04-25T20:52:22.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-04-25T20:52:22.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-04-25T20:52:22.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-04-25T20:52:22.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-04-25T20:52:22.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-04-25T20:52:22.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/ 2024-04-25T20:52:22.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-04-25T20:52:22.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-04-25T20:52:22.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-04-25T20:52:22.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-04-25T20:52:22.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-04-25T20:52:22.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-04-25T20:52:22.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-04-25T20:52:22.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-04-25T20:52:22.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-04-25T20:52:22.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-04-25T20:52:22.393 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-04-25T20:52:22.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/ 2024-04-25T20:52:22.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-04-25T20:52:22.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-04-25T20:52:22.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-04-25T20:52:22.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-04-25T20:52:22.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-04-25T20:52:22.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-04-25T20:52:22.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-04-25T20:52:22.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-04-25T20:52:22.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-04-25T20:52:22.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-04-25T20:52:22.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-04-25T20:52:22.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gcov.txt 2024-04-25T20:52:22.412 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-04-25T20:52:22.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/ 2024-04-25T20:52:22.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-04-25T20:52:22.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-04-25T20:52:22.418 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-04-25T20:52:22.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-04-25T20:52:22.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-04-25T20:52:22.422 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-04-25T20:52:22.423 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-04-25T20:52:22.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/ 2024-04-25T20:52:22.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-04-25T20:52:22.428 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-04-25T20:52:22.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-04-25T20:52:22.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-04-25T20:52:22.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-04-25T20:52:22.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/highuid.txt 2024-04-25T20:52:22.434 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hsi.txt 2024-04-25T20:52:22.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-04-25T20:52:22.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ 2024-04-25T20:52:22.439 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-04-25T20:52:22.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-04-25T20:52:22.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-04-25T20:52:22.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-04-25T20:52:22.445 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-04-25T20:52:22.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-04-25T20:52:22.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-04-25T20:52:22.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-04-25T20:52:22.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-04-25T20:52:22.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-04-25T20:52:22.452 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-04-25T20:52:22.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-04-25T20:52:22.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-04-25T20:52:22.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-04-25T20:52:22.457 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-04-25T20:52:22.459 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-04-25T20:52:22.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-04-25T20:52:22.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-04-25T20:52:22.463 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-04-25T20:52:22.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-04-25T20:52:22.465 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-04-25T20:52:22.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-04-25T20:52:22.468 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-04-25T20:52:22.469 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-04-25T20:52:22.471 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-04-25T20:52:22.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-04-25T20:52:22.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-04-25T20:52:22.474 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-04-25T20:52:22.476 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-04-25T20:52:22.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-04-25T20:52:22.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-04-25T20:52:22.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-04-25T20:52:22.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-04-25T20:52:22.482 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-04-25T20:52:22.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-04-25T20:52:22.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-04-25T20:52:22.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-04-25T20:52:22.487 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-04-25T20:52:22.489 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-04-25T20:52:22.490 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-04-25T20:52:22.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-04-25T20:52:22.492 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-04-25T20:52:22.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-04-25T20:52:22.495 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-04-25T20:52:22.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-04-25T20:52:22.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-04-25T20:52:22.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-04-25T20:52:22.500 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-04-25T20:52:22.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-04-25T20:52:22.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-04-25T20:52:22.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-04-25T20:52:22.505 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-04-25T20:52:22.507 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-04-25T20:52:22.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-04-25T20:52:22.509 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-04-25T20:52:22.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-04-25T20:52:22.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-04-25T20:52:22.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-04-25T20:52:22.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-04-25T20:52:22.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-04-25T20:52:22.517 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-04-25T20:52:22.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-04-25T20:52:22.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-04-25T20:52:22.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-04-25T20:52:22.522 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-04-25T20:52:22.524 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-04-25T20:52:22.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-04-25T20:52:22.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-04-25T20:52:22.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-04-25T20:52:22.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-04-25T20:52:22.530 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-04-25T20:52:22.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-04-25T20:52:22.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-04-25T20:52:22.534 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-04-25T20:52:22.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-04-25T20:52:22.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-04-25T20:52:22.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-04-25T20:52:22.539 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-04-25T20:52:22.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-04-25T20:52:22.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-04-25T20:52:22.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-04-25T20:52:22.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-04-25T20:52:22.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-04-25T20:52:22.547 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-04-25T20:52:22.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-04-25T20:52:22.550 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-04-25T20:52:22.552 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-04-25T20:52:22.553 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-04-25T20:52:22.554 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-04-25T20:52:22.555 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-04-25T20:52:22.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-04-25T20:52:22.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-04-25T20:52:22.559 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-04-25T20:52:22.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-04-25T20:52:22.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-04-25T20:52:22.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-04-25T20:52:22.565 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-04-25T20:52:22.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-04-25T20:52:22.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-04-25T20:52:22.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-04-25T20:52:22.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-04-25T20:52:22.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-04-25T20:52:22.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-04-25T20:52:22.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-04-25T20:52:22.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-04-25T20:52:22.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-04-25T20:52:22.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-04-25T20:52:22.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-04-25T20:52:22.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-04-25T20:52:22.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-04-25T20:52:22.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-04-25T20:52:22.584 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-04-25T20:52:22.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-04-25T20:52:22.587 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-04-25T20:52:22.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-04-25T20:52:22.589 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-04-25T20:52:22.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-04-25T20:52:22.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-04-25T20:52:22.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-04-25T20:52:22.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-04-25T20:52:22.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-04-25T20:52:22.596 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-04-25T20:52:22.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-04-25T20:52:22.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-04-25T20:52:22.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-04-25T20:52:22.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-04-25T20:52:22.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-04-25T20:52:22.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-04-25T20:52:22.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-04-25T20:52:22.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-04-25T20:52:22.607 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-04-25T20:52:22.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-04-25T20:52:22.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-04-25T20:52:22.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-04-25T20:52:22.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-04-25T20:52:22.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-04-25T20:52:22.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-04-25T20:52:22.616 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/ 2024-04-25T20:52:22.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-04-25T20:52:22.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-04-25T20:52:22.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-04-25T20:52:22.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-04-25T20:52:22.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-04-25T20:52:22.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-04-25T20:52:22.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-04-25T20:52:22.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-04-25T20:52:22.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-04-25T20:52:22.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-04-25T20:52:22.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-04-25T20:52:22.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-04-25T20:52:22.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-04-25T20:52:22.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-04-25T20:52:22.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-04-25T20:52:22.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-04-25T20:52:22.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-04-25T20:52:22.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-04-25T20:52:22.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-04-25T20:52:22.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-04-25T20:52:22.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-04-25T20:52:22.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-04-25T20:52:22.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-04-25T20:52:22.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-04-25T20:52:22.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-04-25T20:52:22.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-04-25T20:52:22.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-04-25T20:52:22.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-04-25T20:52:22.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-04-25T20:52:22.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-04-25T20:52:22.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-04-25T20:52:22.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-04-25T20:52:22.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/summary 2024-04-25T20:52:22.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-04-25T20:52:22.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-04-25T20:52:22.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-04-25T20:52:22.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/ 2024-04-25T20:52:22.681 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/README 2024-04-25T20:52:22.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-04-25T20:52:22.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/ 2024-04-25T20:52:22.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-04-25T20:52:22.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-04-25T20:52:22.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-04-25T20:52:22.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/README 2024-04-25T20:52:22.691 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-04-25T20:52:22.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-04-25T20:52:22.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-04-25T20:52:22.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-04-25T20:52:22.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-04-25T20:52:22.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-04-25T20:52:22.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-04-25T20:52:22.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-04-25T20:52:22.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ 2024-04-25T20:52:22.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-04-25T20:52:22.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-04-25T20:52:22.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-04-25T20:52:22.953 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-04-25T20:52:22.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-04-25T20:52:22.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-04-25T20:52:22.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-04-25T20:52:22.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/ 2024-04-25T20:52:22.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-04-25T20:52:22.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-04-25T20:52:22.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-04-25T20:52:22.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-04-25T20:52:22.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-04-25T20:52:22.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/init.txt 2024-04-25T20:52:22.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/initrd.txt 2024-04-25T20:52:22.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ 2024-04-25T20:52:22.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-04-25T20:52:22.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-04-25T20:52:22.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-04-25T20:52:22.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-04-25T20:52:22.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-04-25T20:52:22.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-04-25T20:52:22.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-04-25T20:52:22.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-04-25T20:52:22.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-04-25T20:52:22.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-04-25T20:52:22.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-04-25T20:52:22.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-04-25T20:52:22.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-04-25T20:52:22.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-04-25T20:52:22.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-04-25T20:52:22.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-04-25T20:52:22.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-04-25T20:52:22.993 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/input.txt 2024-04-25T20:52:22.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-04-25T20:52:22.996 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-04-25T20:52:22.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-04-25T20:52:22.998 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-04-25T20:52:23.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-04-25T20:52:23.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-04-25T20:52:23.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-04-25T20:52:23.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-04-25T20:52:23.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-04-25T20:52:23.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-04-25T20:52:23.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-04-25T20:52:23.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-04-25T20:52:23.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-04-25T20:52:23.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-04-25T20:52:23.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-04-25T20:52:23.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-04-25T20:52:23.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ 2024-04-25T20:52:23.017 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-04-25T20:52:23.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-04-25T20:52:23.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-04-25T20:52:23.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-04-25T20:52:23.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-04-25T20:52:23.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-04-25T20:52:23.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/iostats.txt 2024-04-25T20:52:23.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-04-25T20:52:23.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-04-25T20:52:23.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/ 2024-04-25T20:52:23.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-04-25T20:52:23.030 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-04-25T20:52:23.031 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-04-25T20:52:23.032 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-04-25T20:52:23.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-04-25T20:52:23.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-04-25T20:52:23.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README 2024-04-25T20:52:23.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-04-25T20:52:23.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-04-25T20:52:23.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-04-25T20:52:23.040 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-04-25T20:52:23.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-04-25T20:52:23.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-04-25T20:52:23.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-04-25T20:52:23.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-04-25T20:52:23.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-04-25T20:52:23.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-04-25T20:52:23.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-04-25T20:52:23.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-04-25T20:52:23.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-04-25T20:52:23.054 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-04-25T20:52:23.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-04-25T20:52:23.056 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-04-25T20:52:23.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-04-25T20:52:23.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-04-25T20:52:23.061 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-04-25T20:52:23.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-04-25T20:52:23.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-04-25T20:52:23.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-04-25T20:52:23.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-04-25T20:52:23.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-04-25T20:52:23.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/java.txt 2024-04-25T20:52:23.070 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kasan.txt 2024-04-25T20:52:23.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/ 2024-04-25T20:52:23.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-04-25T20:52:23.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-04-25T20:52:23.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-04-25T20:52:23.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-04-25T20:52:23.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-04-25T20:52:23.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-04-25T20:52:23.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-04-25T20:52:23.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/ 2024-04-25T20:52:23.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-04-25T20:52:23.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-04-25T20:52:23.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-04-25T20:52:23.090 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-04-25T20:52:23.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-04-25T20:52:23.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-04-25T20:52:23.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-04-25T20:52:23.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-04-25T20:52:23.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-04-25T20:52:23.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-04-25T20:52:23.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-04-25T20:52:23.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kobject.txt 2024-04-25T20:52:23.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-04-25T20:52:23.109 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kref.txt 2024-04-25T20:52:23.111 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-04-25T20:52:23.113 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/ 2024-04-25T20:52:23.115 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-04-25T20:52:23.116 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-04-25T20:52:23.117 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-04-25T20:52:23.118 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-04-25T20:52:23.119 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-04-25T20:52:23.120 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-04-25T20:52:23.121 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-04-25T20:52:23.122 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-04-25T20:52:23.124 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-04-25T20:52:23.125 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-04-25T20:52:23.126 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-04-25T20:52:23.127 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-04-25T20:52:23.128 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ldm.txt 2024-04-25T20:52:23.129 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ 2024-04-25T20:52:23.132 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-04-25T20:52:23.133 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-04-25T20:52:23.134 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-04-25T20:52:23.136 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-04-25T20:52:23.137 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-04-25T20:52:23.138 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-04-25T20:52:23.139 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-04-25T20:52:23.140 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-04-25T20:52:23.141 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-04-25T20:52:23.142 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-04-25T20:52:23.143 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-04-25T20:52:23.145 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-04-25T20:52:23.146 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/ 2024-04-25T20:52:23.148 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-04-25T20:52:23.149 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-04-25T20:52:23.151 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-04-25T20:52:23.152 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-04-25T20:52:23.153 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-04-25T20:52:23.154 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-04-25T20:52:23.155 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-04-25T20:52:23.157 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-04-25T20:52:23.158 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-04-25T20:52:23.160 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-04-25T20:52:23.161 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-04-25T20:52:23.162 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/logo.gif 2024-04-25T20:52:23.163 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/logo.txt 2024-04-25T20:52:23.164 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/lzo.txt 2024-04-25T20:52:23.166 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/ 2024-04-25T20:52:23.168 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-04-25T20:52:23.169 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-04-25T20:52:23.170 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-04-25T20:52:23.171 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-04-25T20:52:23.172 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-04-25T20:52:23.174 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/md.txt 2024-04-25T20:52:23.175 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-04-25T20:52:23.176 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-04-25T20:52:23.203 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-04-25T20:52:23.204 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-04-25T20:52:23.205 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-04-25T20:52:23.206 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/ 2024-04-25T20:52:23.208 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-04-25T20:52:23.209 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-04-25T20:52:23.211 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/ 2024-04-25T20:52:23.213 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-04-25T20:52:23.217 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-04-25T20:52:23.218 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-04-25T20:52:23.225 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-04-25T20:52:23.226 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-04-25T20:52:23.227 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-04-25T20:52:23.229 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-04-25T20:52:23.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-04-25T20:52:23.230 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-04-25T20:52:23.231 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-04-25T20:52:23.232 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/ 2024-04-25T20:52:23.234 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-04-25T20:52:23.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-04-25T20:52:23.235 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-04-25T20:52:23.237 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-04-25T20:52:23.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-04-25T20:52:23.238 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-04-25T20:52:23.239 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-04-25T20:52:23.240 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-04-25T20:52:23.241 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-04-25T20:52:23.242 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-04-25T20:52:23.243 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-04-25T20:52:23.244 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-04-25T20:52:23.245 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-04-25T20:52:23.246 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-04-25T20:52:23.247 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-04-25T20:52:23.248 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-04-25T20:52:23.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-04-25T20:52:23.249 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-04-25T20:52:23.250 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-04-25T20:52:23.251 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-04-25T20:52:23.252 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-04-25T20:52:23.253 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/ 2024-04-25T20:52:23.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-04-25T20:52:23.255 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-04-25T20:52:23.256 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-04-25T20:52:23.257 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-04-25T20:52:23.258 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/ 2024-04-25T20:52:23.259 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-04-25T20:52:23.260 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-04-25T20:52:23.261 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-04-25T20:52:23.262 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mono.txt 2024-04-25T20:52:23.263 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/ 2024-04-25T20:52:23.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-04-25T20:52:23.265 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-04-25T20:52:23.266 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-04-25T20:52:23.267 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-04-25T20:52:23.269 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/ 2024-04-25T20:52:23.270 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-04-25T20:52:23.271 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-04-25T20:52:23.272 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/ 2024-04-25T20:52:23.273 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-04-25T20:52:23.274 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-04-25T20:52:23.275 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-04-25T20:52:23.276 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-04-25T20:52:23.277 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-04-25T20:52:23.278 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ 2024-04-25T20:52:23.280 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-04-25T20:52:23.281 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-04-25T20:52:23.282 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-04-25T20:52:23.283 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-04-25T20:52:23.284 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-04-25T20:52:23.285 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-04-25T20:52:23.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-04-25T20:52:23.286 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-04-25T20:52:23.288 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-04-25T20:52:23.289 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-04-25T20:52:23.290 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-04-25T20:52:23.291 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-04-25T20:52:23.292 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-04-25T20:52:23.293 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-04-25T20:52:23.294 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-04-25T20:52:23.295 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-04-25T20:52:23.296 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-04-25T20:52:23.297 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-04-25T20:52:23.298 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-04-25T20:52:23.299 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-04-25T20:52:23.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-04-25T20:52:23.301 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-04-25T20:52:23.302 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-04-25T20:52:23.303 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-04-25T20:52:23.305 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-04-25T20:52:23.306 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-04-25T20:52:23.307 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-04-25T20:52:23.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-04-25T20:52:23.308 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-04-25T20:52:23.309 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-04-25T20:52:23.310 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-04-25T20:52:23.311 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-04-25T20:52:23.312 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-04-25T20:52:23.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-04-25T20:52:23.314 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-04-25T20:52:23.316 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-04-25T20:52:23.317 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-04-25T20:52:23.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-04-25T20:52:23.318 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-04-25T20:52:23.319 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-04-25T20:52:23.320 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-04-25T20:52:23.321 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-04-25T20:52:23.322 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-04-25T20:52:23.323 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-04-25T20:52:23.324 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-04-25T20:52:23.325 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-04-25T20:52:23.326 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-04-25T20:52:23.328 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-04-25T20:52:23.329 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-04-25T20:52:23.330 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-04-25T20:52:23.331 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-04-25T20:52:23.332 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-04-25T20:52:23.333 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-04-25T20:52:23.334 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-04-25T20:52:23.335 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-04-25T20:52:23.336 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-04-25T20:52:23.337 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-04-25T20:52:23.338 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-04-25T20:52:23.339 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-04-25T20:52:23.340 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-04-25T20:52:23.341 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-04-25T20:52:23.342 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-04-25T20:52:23.343 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-04-25T20:52:23.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-04-25T20:52:23.344 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-04-25T20:52:23.346 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-04-25T20:52:23.347 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-04-25T20:52:23.348 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-04-25T20:52:23.349 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-04-25T20:52:23.350 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-04-25T20:52:23.351 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-04-25T20:52:23.352 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-04-25T20:52:23.353 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-04-25T20:52:23.354 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-04-25T20:52:23.355 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-04-25T20:52:23.356 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-04-25T20:52:23.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-04-25T20:52:23.357 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-04-25T20:52:23.359 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-04-25T20:52:23.360 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-04-25T20:52:23.361 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-04-25T20:52:23.362 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-04-25T20:52:23.363 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-04-25T20:52:23.364 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-04-25T20:52:23.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-04-25T20:52:23.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-04-25T20:52:23.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-04-25T20:52:23.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-04-25T20:52:23.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-04-25T20:52:23.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-04-25T20:52:23.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-04-25T20:52:23.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-04-25T20:52:23.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-04-25T20:52:23.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-04-25T20:52:23.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-04-25T20:52:23.376 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-04-25T20:52:23.377 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-04-25T20:52:23.378 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-04-25T20:52:23.379 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-04-25T20:52:23.380 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-04-25T20:52:23.381 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-04-25T20:52:23.382 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-04-25T20:52:23.383 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-04-25T20:52:23.384 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-04-25T20:52:23.385 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-04-25T20:52:23.386 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-04-25T20:52:23.387 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-04-25T20:52:23.388 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-04-25T20:52:23.389 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-04-25T20:52:23.390 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-04-25T20:52:23.391 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-04-25T20:52:23.392 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-04-25T20:52:23.394 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-04-25T20:52:23.395 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-04-25T20:52:23.396 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-04-25T20:52:23.397 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-04-25T20:52:23.398 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-04-25T20:52:23.400 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-04-25T20:52:23.401 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-04-25T20:52:23.402 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-04-25T20:52:23.403 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-04-25T20:52:23.404 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-04-25T20:52:23.405 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-04-25T20:52:23.406 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-04-25T20:52:23.408 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-04-25T20:52:23.409 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-04-25T20:52:23.410 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-04-25T20:52:23.411 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-04-25T20:52:23.413 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-04-25T20:52:23.414 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-04-25T20:52:23.415 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-04-25T20:52:23.416 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-04-25T20:52:23.417 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-04-25T20:52:23.419 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-04-25T20:52:23.420 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-04-25T20:52:23.421 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/ 2024-04-25T20:52:23.424 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-04-25T20:52:23.425 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-04-25T20:52:23.426 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nios2/ 2024-04-25T20:52:23.429 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nios2/README 2024-04-25T20:52:23.430 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-04-25T20:52:23.431 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/numastat.txt 2024-04-25T20:52:23.432 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-04-25T20:52:23.433 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/padata.txt 2024-04-25T20:52:23.435 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/ 2024-04-25T20:52:23.437 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-04-25T20:52:23.438 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-04-25T20:52:23.440 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parisc/registers 2024-04-25T20:52:23.441 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-04-25T20:52:23.442 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/parport.txt 2024-04-25T20:52:23.443 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-04-25T20:52:23.446 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-04-25T20:52:23.447 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-04-25T20:52:23.448 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-04-25T20:52:23.449 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-04-25T20:52:23.450 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-04-25T20:52:23.451 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-04-25T20:52:23.453 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-04-25T20:52:23.454 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-04-25T20:52:23.455 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy.txt 2024-04-25T20:52:23.456 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy/ 2024-04-25T20:52:23.458 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-04-25T20:52:23.460 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-04-25T20:52:23.461 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-04-25T20:52:23.462 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/platform/ 2024-04-25T20:52:23.464 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-04-25T20:52:23.466 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pnp.txt 2024-04-25T20:52:23.467 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/ 2024-04-25T20:52:23.470 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-04-25T20:52:23.472 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-04-25T20:52:23.473 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-04-25T20:52:23.475 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-04-25T20:52:23.477 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-04-25T20:52:23.478 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-04-25T20:52:23.480 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-04-25T20:52:23.481 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-04-25T20:52:23.483 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-04-25T20:52:23.485 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-04-25T20:52:23.486 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-04-25T20:52:23.488 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-04-25T20:52:23.489 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-04-25T20:52:23.491 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-04-25T20:52:23.493 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-04-25T20:52:23.494 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-04-25T20:52:23.496 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-04-25T20:52:23.497 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-04-25T20:52:23.498 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-04-25T20:52:23.499 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-04-25T20:52:23.501 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-04-25T20:52:23.502 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-04-25T20:52:23.503 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-04-25T20:52:23.504 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/states.txt 2024-04-25T20:52:23.506 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-04-25T20:52:23.507 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-04-25T20:52:23.508 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-04-25T20:52:23.510 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-04-25T20:52:23.511 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-04-25T20:52:23.512 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-04-25T20:52:23.513 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-04-25T20:52:23.514 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/power/video.txt 2024-04-25T20:52:23.516 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/ 2024-04-25T20:52:23.518 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-04-25T20:52:23.519 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-04-25T20:52:23.520 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-04-25T20:52:23.521 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-04-25T20:52:23.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-04-25T20:52:23.523 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-04-25T20:52:23.525 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-04-25T20:52:23.526 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-04-25T20:52:23.527 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-04-25T20:52:23.528 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-04-25T20:52:23.529 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-04-25T20:52:23.531 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-04-25T20:52:23.532 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-04-25T20:52:23.533 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pps/ 2024-04-25T20:52:23.535 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-04-25T20:52:23.536 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/ 2024-04-25T20:52:23.538 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-04-25T20:52:23.540 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-04-25T20:52:23.541 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-04-25T20:52:23.542 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-04-25T20:52:23.543 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-04-25T20:52:23.544 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-04-25T20:52:23.545 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-04-25T20:52:23.546 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-04-25T20:52:23.548 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-04-25T20:52:23.549 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pti/ 2024-04-25T20:52:23.557 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-04-25T20:52:23.558 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/ 2024-04-25T20:52:23.560 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-04-25T20:52:23.561 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-04-25T20:52:23.562 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-04-25T20:52:23.563 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-04-25T20:52:23.564 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-04-25T20:52:23.566 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/pwm.txt 2024-04-25T20:52:23.567 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-04-25T20:52:23.568 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/ 2024-04-25T20:52:23.570 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-04-25T20:52:23.571 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-04-25T20:52:23.572 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-04-25T20:52:23.573 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-04-25T20:52:23.574 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-04-25T20:52:23.575 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-04-25T20:52:23.576 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-04-25T20:52:23.577 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-04-25T20:52:23.578 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-04-25T20:52:23.579 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/rtc.txt 2024-04-25T20:52:23.580 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/ 2024-04-25T20:52:23.582 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-04-25T20:52:23.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-04-25T20:52:23.583 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-04-25T20:52:23.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-04-25T20:52:23.585 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/DASD 2024-04-25T20:52:23.586 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-04-25T20:52:23.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-04-25T20:52:23.588 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-04-25T20:52:23.590 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-04-25T20:52:23.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-04-25T20:52:23.591 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-04-25T20:52:23.592 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-04-25T20:52:23.593 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-04-25T20:52:23.594 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-04-25T20:52:23.595 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/ 2024-04-25T20:52:23.597 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-04-25T20:52:23.598 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-04-25T20:52:23.599 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-04-25T20:52:23.600 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-04-25T20:52:23.601 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-04-25T20:52:23.602 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-04-25T20:52:23.603 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-04-25T20:52:23.604 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-04-25T20:52:23.605 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-04-25T20:52:23.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-04-25T20:52:23.606 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ 2024-04-25T20:52:23.608 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-04-25T20:52:23.609 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-04-25T20:52:23.610 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-04-25T20:52:23.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-04-25T20:52:23.611 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-04-25T20:52:23.612 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-04-25T20:52:23.613 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-04-25T20:52:23.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-04-25T20:52:23.615 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-04-25T20:52:23.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-04-25T20:52:23.617 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-04-25T20:52:23.618 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-04-25T20:52:23.619 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-04-25T20:52:23.620 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-04-25T20:52:23.621 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-04-25T20:52:23.622 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-04-25T20:52:23.623 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-04-25T20:52:23.624 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-04-25T20:52:23.625 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-04-25T20:52:23.626 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-04-25T20:52:23.627 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-04-25T20:52:23.628 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-04-25T20:52:23.629 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-04-25T20:52:23.630 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-04-25T20:52:23.631 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-04-25T20:52:23.632 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-04-25T20:52:23.633 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-04-25T20:52:23.634 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-04-25T20:52:23.635 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-04-25T20:52:23.636 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-04-25T20:52:23.637 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-04-25T20:52:23.638 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-04-25T20:52:23.639 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-04-25T20:52:23.640 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-04-25T20:52:23.641 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-04-25T20:52:23.642 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-04-25T20:52:23.643 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-04-25T20:52:23.644 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-04-25T20:52:23.645 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-04-25T20:52:23.646 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-04-25T20:52:23.647 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-04-25T20:52:23.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-04-25T20:52:23.648 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-04-25T20:52:23.650 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-04-25T20:52:23.651 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-04-25T20:52:23.652 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-04-25T20:52:23.653 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-04-25T20:52:23.654 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-04-25T20:52:23.655 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-04-25T20:52:23.656 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-04-25T20:52:23.657 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-04-25T20:52:23.658 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-04-25T20:52:23.659 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-04-25T20:52:23.660 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-04-25T20:52:23.661 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-04-25T20:52:23.662 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-04-25T20:52:23.663 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-04-25T20:52:23.664 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-04-25T20:52:23.665 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-04-25T20:52:23.666 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/ 2024-04-25T20:52:23.667 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-04-25T20:52:23.668 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-04-25T20:52:23.669 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-04-25T20:52:23.670 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-04-25T20:52:23.671 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-04-25T20:52:23.672 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-04-25T20:52:23.673 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-04-25T20:52:23.674 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-04-25T20:52:23.675 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-04-25T20:52:23.676 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-04-25T20:52:23.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-04-25T20:52:23.677 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-04-25T20:52:23.678 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-04-25T20:52:23.679 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-04-25T20:52:23.680 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/ 2024-04-25T20:52:23.682 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-04-25T20:52:23.683 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-04-25T20:52:23.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/driver 2024-04-25T20:52:23.684 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-04-25T20:52:23.685 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-04-25T20:52:23.686 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-04-25T20:52:23.687 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-04-25T20:52:23.688 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-04-25T20:52:23.690 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-04-25T20:52:23.692 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/ 2024-04-25T20:52:23.694 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-04-25T20:52:23.695 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-04-25T20:52:23.697 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-04-25T20:52:23.699 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/ 2024-04-25T20:52:23.700 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-04-25T20:52:23.701 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-04-25T20:52:23.702 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-04-25T20:52:23.703 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-04-25T20:52:23.704 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-04-25T20:52:23.705 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-04-25T20:52:23.706 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-04-25T20:52:23.707 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-04-25T20:52:23.708 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-04-25T20:52:23.709 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-04-25T20:52:23.710 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-04-25T20:52:23.711 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-04-25T20:52:23.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-04-25T20:52:23.712 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-04-25T20:52:23.713 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-04-25T20:52:23.714 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-04-25T20:52:23.715 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-04-25T20:52:23.716 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-04-25T20:52:23.717 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-04-25T20:52:23.718 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-04-25T20:52:23.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-04-25T20:52:23.719 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-04-25T20:52:23.721 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-04-25T20:52:23.722 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-04-25T20:52:23.724 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-04-25T20:52:23.725 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-04-25T20:52:23.727 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-04-25T20:52:23.728 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-04-25T20:52:23.729 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-04-25T20:52:23.731 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-04-25T20:52:23.732 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-04-25T20:52:23.733 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-04-25T20:52:23.735 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-04-25T20:52:23.736 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-04-25T20:52:23.737 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-04-25T20:52:23.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-04-25T20:52:23.738 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-04-25T20:52:23.739 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-04-25T20:52:23.740 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-04-25T20:52:23.741 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-04-25T20:52:23.742 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-04-25T20:52:23.743 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-04-25T20:52:23.744 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-04-25T20:52:23.745 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-04-25T20:52:23.746 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-04-25T20:52:23.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-04-25T20:52:23.747 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-04-25T20:52:23.748 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-04-25T20:52:23.749 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-04-25T20:52:23.750 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-04-25T20:52:23.751 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-04-25T20:52:23.752 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-04-25T20:52:23.753 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-04-25T20:52:23.754 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-04-25T20:52:23.756 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-04-25T20:52:23.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-04-25T20:52:23.757 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-04-25T20:52:23.758 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-04-25T20:52:23.759 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-04-25T20:52:23.760 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-04-25T20:52:23.761 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-04-25T20:52:23.762 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-04-25T20:52:23.763 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sparse.txt 2024-04-25T20:52:23.764 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/ 2024-04-25T20:52:23.766 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-04-25T20:52:23.768 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-04-25T20:52:23.769 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-04-25T20:52:23.771 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-04-25T20:52:23.772 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-04-25T20:52:23.774 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-04-25T20:52:23.775 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-04-25T20:52:23.777 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-04-25T20:52:23.778 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-04-25T20:52:23.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev 2024-04-25T20:52:23.780 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-04-25T20:52:23.782 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-04-25T20:52:23.783 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-04-25T20:52:23.784 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-04-25T20:52:23.785 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-04-25T20:52:23.786 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/svga.txt 2024-04-25T20:52:23.787 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/ 2024-04-25T20:52:23.788 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-04-25T20:52:23.789 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/README 2024-04-25T20:52:23.790 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-04-25T20:52:23.791 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-04-25T20:52:23.792 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-04-25T20:52:23.793 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-04-25T20:52:23.794 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-04-25T20:52:23.795 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-04-25T20:52:23.796 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-04-25T20:52:23.797 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-04-25T20:52:23.798 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/ 2024-04-25T20:52:23.799 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-04-25T20:52:23.800 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-04-25T20:52:23.801 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-04-25T20:52:23.802 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/ 2024-04-25T20:52:23.803 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-04-25T20:52:23.804 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-04-25T20:52:23.805 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-04-25T20:52:23.806 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-04-25T20:52:23.807 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-04-25T20:52:23.808 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-04-25T20:52:23.809 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-04-25T20:52:23.810 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-04-25T20:52:23.811 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/ 2024-04-25T20:52:23.812 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-04-25T20:52:23.813 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-04-25T20:52:23.814 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-04-25T20:52:23.815 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-04-25T20:52:23.816 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-04-25T20:52:23.817 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-04-25T20:52:23.818 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-04-25T20:52:23.819 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-04-25T20:52:23.820 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-04-25T20:52:23.821 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-04-25T20:52:23.822 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-04-25T20:52:23.823 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/tpm/ 2024-04-25T20:52:23.825 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-04-25T20:52:23.826 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ 2024-04-25T20:52:23.827 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-04-25T20:52:23.828 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-04-25T20:52:23.829 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-04-25T20:52:23.830 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-04-25T20:52:23.831 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-04-25T20:52:23.832 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-04-25T20:52:23.834 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-04-25T20:52:23.835 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-04-25T20:52:23.836 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-04-25T20:52:23.837 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-04-25T20:52:23.838 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-04-25T20:52:23.839 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-04-25T20:52:23.840 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-04-25T20:52:23.841 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-04-25T20:52:23.842 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-04-25T20:52:23.843 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-04-25T20:52:23.844 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-04-25T20:52:23.845 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-04-25T20:52:23.846 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unicode.txt 2024-04-25T20:52:23.847 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/unshare.txt 2024-04-25T20:52:23.848 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ 2024-04-25T20:52:23.849 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-04-25T20:52:23.850 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-04-25T20:52:23.851 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-04-25T20:52:23.852 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-04-25T20:52:23.853 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-04-25T20:52:23.854 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-04-25T20:52:23.855 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-04-25T20:52:23.856 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-04-25T20:52:23.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-04-25T20:52:23.857 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-04-25T20:52:23.858 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-04-25T20:52:23.860 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-04-25T20:52:23.861 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-04-25T20:52:23.862 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-04-25T20:52:23.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-04-25T20:52:23.863 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-04-25T20:52:23.865 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-04-25T20:52:23.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-04-25T20:52:23.866 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-04-25T20:52:23.868 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-04-25T20:52:23.869 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-04-25T20:52:23.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-04-25T20:52:23.870 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-04-25T20:52:23.871 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-04-25T20:52:23.872 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-04-25T20:52:23.874 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-04-25T20:52:23.875 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-04-25T20:52:23.876 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-04-25T20:52:23.877 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-04-25T20:52:23.878 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-04-25T20:52:23.879 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-04-25T20:52:23.880 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-04-25T20:52:23.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-04-25T20:52:23.881 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-04-25T20:52:23.882 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-04-25T20:52:23.883 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-04-25T20:52:23.884 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/ 2024-04-25T20:52:23.886 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-04-25T20:52:23.887 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-04-25T20:52:23.888 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-04-25T20:52:23.889 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-04-25T20:52:23.890 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-04-25T20:52:23.891 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vfio.txt 2024-04-25T20:52:23.892 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-04-25T20:52:23.893 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video-output.txt 2024-04-25T20:52:23.894 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/ 2024-04-25T20:52:23.895 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-04-25T20:52:23.896 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-04-25T20:52:23.897 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-04-25T20:52:23.898 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-04-25T20:52:23.899 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-04-25T20:52:23.900 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-04-25T20:52:23.901 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-04-25T20:52:23.902 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-04-25T20:52:23.903 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-04-25T20:52:23.904 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-04-25T20:52:23.905 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-04-25T20:52:23.906 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-04-25T20:52:23.907 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-04-25T20:52:23.908 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-04-25T20:52:23.909 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-04-25T20:52:23.910 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-04-25T20:52:23.911 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-04-25T20:52:23.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-04-25T20:52:23.912 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-04-25T20:52:23.913 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-04-25T20:52:23.914 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-04-25T20:52:23.915 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-04-25T20:52:23.916 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-04-25T20:52:23.917 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-04-25T20:52:23.918 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-04-25T20:52:23.919 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-04-25T20:52:23.920 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-04-25T20:52:23.921 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-04-25T20:52:23.922 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-04-25T20:52:23.923 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-04-25T20:52:23.924 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-04-25T20:52:23.925 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-04-25T20:52:23.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-04-25T20:52:23.926 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-04-25T20:52:23.927 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-04-25T20:52:23.928 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-04-25T20:52:23.930 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-04-25T20:52:23.931 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-04-25T20:52:23.932 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-04-25T20:52:23.933 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-04-25T20:52:23.934 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-04-25T20:52:23.935 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-04-25T20:52:23.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-04-25T20:52:23.936 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-04-25T20:52:23.937 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-04-25T20:52:23.938 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-04-25T20:52:23.939 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-04-25T20:52:23.940 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-04-25T20:52:23.941 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-04-25T20:52:23.942 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-04-25T20:52:23.944 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-04-25T20:52:23.945 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-04-25T20:52:23.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-04-25T20:52:23.946 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-04-25T20:52:23.947 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-04-25T20:52:23.948 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-04-25T20:52:23.949 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-04-25T20:52:23.950 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-04-25T20:52:23.951 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-04-25T20:52:23.952 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-04-25T20:52:23.954 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-04-25T20:52:23.955 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-04-25T20:52:23.956 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-04-25T20:52:23.957 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-04-25T20:52:23.958 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-04-25T20:52:23.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-04-25T20:52:23.959 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-04-25T20:52:23.960 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-04-25T20:52:23.961 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-04-25T20:52:23.962 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-04-25T20:52:23.963 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-04-25T20:52:23.964 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-04-25T20:52:23.965 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-04-25T20:52:23.966 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-04-25T20:52:23.967 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-04-25T20:52:23.968 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-04-25T20:52:23.969 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-04-25T20:52:23.970 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-04-25T20:52:23.971 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/ 2024-04-25T20:52:23.972 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-04-25T20:52:23.973 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-04-25T20:52:23.974 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-04-25T20:52:23.975 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-04-25T20:52:23.976 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-04-25T20:52:23.977 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-04-25T20:52:23.978 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-04-25T20:52:23.979 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-04-25T20:52:23.980 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-04-25T20:52:23.981 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-04-25T20:52:23.982 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-04-25T20:52:23.983 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-04-25T20:52:23.984 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-04-25T20:52:23.985 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-04-25T20:52:23.986 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-04-25T20:52:23.987 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-04-25T20:52:23.988 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-04-25T20:52:23.989 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-04-25T20:52:23.990 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-04-25T20:52:23.991 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-04-25T20:52:23.992 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-04-25T20:52:23.993 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-04-25T20:52:23.994 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-04-25T20:52:23.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-04-25T20:52:23.995 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-04-25T20:52:23.997 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/ 2024-04-25T20:52:23.999 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-04-25T20:52:24.000 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-04-25T20:52:24.001 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-04-25T20:52:24.002 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/balance 2024-04-25T20:52:24.003 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-04-25T20:52:24.004 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-04-25T20:52:24.005 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-04-25T20:52:24.006 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-04-25T20:52:24.007 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-04-25T20:52:24.008 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-04-25T20:52:24.009 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/numa 2024-04-25T20:52:24.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-04-25T20:52:24.010 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-04-25T20:52:24.011 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-04-25T20:52:24.012 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-04-25T20:52:24.013 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-04-25T20:52:24.014 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-04-25T20:52:24.015 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-04-25T20:52:24.016 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-04-25T20:52:24.018 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-04-25T20:52:24.019 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-04-25T20:52:24.020 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-04-25T20:52:24.021 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-04-25T20:52:24.022 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-04-25T20:52:24.023 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-04-25T20:52:24.024 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/ 2024-04-25T20:52:24.025 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-04-25T20:52:24.026 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-04-25T20:52:24.027 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-04-25T20:52:24.028 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-04-25T20:52:24.029 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-04-25T20:52:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-04-25T20:52:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-04-25T20:52:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-04-25T20:52:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-04-25T20:52:24.034 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-04-25T20:52:24.035 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-04-25T20:52:24.036 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-04-25T20:52:24.037 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-04-25T20:52:24.038 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-04-25T20:52:24.039 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-04-25T20:52:24.041 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-04-25T20:52:24.042 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/ 2024-04-25T20:52:24.043 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-04-25T20:52:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:23 smithi043 ceph-mon[29167]: pgmap v75: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 63 op/s 2024-04-25T20:52:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:23 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:24.044 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-04-25T20:52:24.045 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-04-25T20:52:24.046 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-04-25T20:52:24.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-04-25T20:52:24.047 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-04-25T20:52:24.048 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-04-25T20:52:24.049 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-04-25T20:52:24.050 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-04-25T20:52:24.051 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-04-25T20:52:24.052 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-04-25T20:52:24.053 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-04-25T20:52:24.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-04-25T20:52:24.055 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/ 2024-04-25T20:52:24.057 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-04-25T20:52:24.058 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-04-25T20:52:24.059 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-04-25T20:52:24.060 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/ 2024-04-25T20:52:24.062 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-04-25T20:52:24.063 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-04-25T20:52:24.064 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-04-25T20:52:24.065 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-04-25T20:52:24.066 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-04-25T20:52:24.067 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-04-25T20:52:24.068 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-04-25T20:52:24.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-04-25T20:52:24.069 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-04-25T20:52:24.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-04-25T20:52:24.071 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-04-25T20:52:24.072 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-04-25T20:52:24.073 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-04-25T20:52:24.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-04-25T20:52:24.075 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-04-25T20:52:24.076 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-04-25T20:52:24.077 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-04-25T20:52:24.078 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-04-25T20:52:24.079 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-04-25T20:52:24.080 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-04-25T20:52:24.081 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-04-25T20:52:24.082 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-04-25T20:52:24.083 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-04-25T20:52:24.084 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-04-25T20:52:24.085 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/ 2024-04-25T20:52:24.086 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-04-25T20:52:24.087 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-04-25T20:52:24.088 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/xz.txt 2024-04-25T20:52:24.089 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-04-25T20:52:24.091 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-04-25T20:52:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:23 smithi195 ceph-mon[33250]: pgmap v75: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 63 op/s 2024-04-25T20:52:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:23 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:23 smithi112 ceph-mon[32322]: pgmap v75: 97 pgs: 97 active+clean; 88 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 415 KiB/s wr, 63 op/s 2024-04-25T20:52:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:23 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:24.092 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-04-25T20:52:24.093 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-04-25T20:52:24.094 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-04-25T20:52:24.095 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-04-25T20:52:24.096 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-04-25T20:52:24.097 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-04-25T20:52:24.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-04-25T20:52:24.098 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-04-25T20:52:24.099 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-04-25T20:52:24.100 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-04-25T20:52:24.101 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-04-25T20:52:24.102 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-04-25T20:52:24.103 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-04-25T20:52:24.104 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-04-25T20:52:24.105 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-04-25T20:52:24.106 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-04-25T20:52:24.107 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-04-25T20:52:24.365 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-04-25T20:52:24.366 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-04-25T20:52:24.367 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-04-25T20:52:24.368 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-04-25T20:52:24.369 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-04-25T20:52:24.370 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-04-25T20:52:24.371 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-04-25T20:52:24.372 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-04-25T20:52:24.373 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-04-25T20:52:24.374 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-04-25T20:52:24.375 INFO:tasks.workunit.client.0.smithi043.stdout:linux-4.0.5/Documentation/zorro.txt 2024-04-25T20:52:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:25 smithi043 ceph-mon[29167]: pgmap v76: 97 pgs: 97 active+clean; 92 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 778 KiB/s wr, 75 op/s 2024-04-25T20:52:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:25 smithi195 ceph-mon[33250]: pgmap v76: 97 pgs: 97 active+clean; 92 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 778 KiB/s wr, 75 op/s 2024-04-25T20:52:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:25 smithi112 ceph-mon[32322]: pgmap v76: 97 pgs: 97 active+clean; 92 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 778 KiB/s wr, 75 op/s 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 -- 172.21.15.43:0/1375574140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478101aa0 msgr2=0x7f7478105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 --2- 172.21.15.43:0/1375574140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478101aa0 0x7f7478105a90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f746c009900 tx=0x7f746c02a410 comp rx=0 tx=0).stop 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 -- 172.21.15.43:0/1375574140 shutdown_connections 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 --2- 172.21.15.43:0/1375574140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7478106170 0x7f747810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 --2- 172.21.15.43:0/1375574140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478101aa0 0x7f7478105a90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 --2- 172.21.15.43:0/1375574140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74781010f0 0x7f74781014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 -- 172.21.15.43:0/1375574140 >> 172.21.15.43:0/1375574140 conn(0x7f7478077fd0 msgr2=0x7f74780783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 -- 172.21.15.43:0/1375574140 shutdown_connections 2024-04-25T20:52:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.158+0000 7f747cc69640 1 -- 172.21.15.43:0/1375574140 wait complete. 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 Processor -- start 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 -- start start 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74781010f0 0x7f7478199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747819a090 0x7f74781a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74781111f0 con 0x7f7478106170 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111070 con 0x7f747819a090 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747cc69640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111370 con 0x7f74781010f0 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f7475d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f7475d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60908/0 (socket says 172.21.15.43:60908) 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f7475d9b640 1 -- 172.21.15.43:0/1458960097 learned_addr learned my addr 172.21.15.43:0/1458960097 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f7476d9d640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747819a090 0x7f74781a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.159+0000 7f747659c640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74781010f0 0x7f7478199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 -- 172.21.15.43:0/1458960097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74781010f0 msgr2=0x7f7478199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74781010f0 0x7f7478199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 -- 172.21.15.43:0/1458960097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747819a090 msgr2=0x7f74781a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747819a090 0x7f74781a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 -- 172.21.15.43:0/1458960097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74781a4e10 con 0x7f7478106170 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f7475d9b640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f746c005940 tx=0x7f746c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f74677fe640 1 -- 172.21.15.43:0/1458960097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c03f030 con 0x7f7478106170 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74781a50a0 con 0x7f7478106170 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f74677fe640 1 -- 172.21.15.43:0/1458960097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f746c031910 con 0x7f7478106170 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f74677fe640 1 -- 172.21.15.43:0/1458960097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c035070 con 0x7f7478106170 2024-04-25T20:52:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.160+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74781a5590 con 0x7f7478106170 2024-04-25T20:52:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.162+0000 7f747f976740 1 Processor -- start 2024-04-25T20:52:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 -- start start 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f74677fe640 1 -- 172.21.15.43:0/1458960097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f746c042030 con 0x7f7478106170 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e301bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f3e259970 con 0x557f3e2f4620 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f3e1f64a0 con 0x557f3e2ff800 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747f976740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557f3e255930 con 0x557f3e2f4f40 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60910/0 (socket says 172.21.15.43:60910) 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 -- 172.21.15.43:0/2278806933 learned_addr learned my addr 172.21.15.43:0/2278806933 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f747659c640 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e301bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 -- 172.21.15.43:0/2278806933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 msgr2=0x557f3e2ff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2ff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 -- 172.21.15.43:0/2278806933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 msgr2=0x557f3e301bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e301bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.163+0000 7f7476d9d640 1 -- 172.21.15.43:0/2278806933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3df6c210 con 0x557f3e2f4620 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f74677fe640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 0x7f74600a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f70 tx=0x7f7470010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db3dd3ae034ed3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f747659c640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 0x7f74600a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f74677fe640 1 -- 172.21.15.43:0/1458960097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f746c0f0be0 con 0x7f7478106170 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f7464ff9640 1 -- 172.21.15.43:0/2278806933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470016070 con 0x557f3e2f4620 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f7464ff9640 1 -- 172.21.15.43:0/2278806933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7470004d20 con 0x557f3e2f4620 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.164+0000 7f7464ff9640 1 -- 172.21.15.43:0/2278806933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470012910 con 0x557f3e2f4620 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- 172.21.15.43:0/2278806933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 msgr2=0x557f3e2f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747659c640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 0x7f74600a6280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557f3e2f5bc0 tx=0x7f746800b390 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f70 tx=0x7f7470010800 comp rx=0 tx=0).stop 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- 172.21.15.43:0/2278806933 shutdown_connections 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e301bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2ff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 --2- 172.21.15.43:0/2278806933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2f4a00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- 172.21.15.43:0/2278806933 >> 172.21.15.43:0/2278806933 conn(0x557f3e2f0b30 msgr2=0x557f3e2f0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- 172.21.15.43:0/2278806933 shutdown_connections 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- 172.21.15.43:0/2278806933 wait complete. 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 -- start start 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.165+0000 7f747f976740 1 Processor -- start 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2fc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e2fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f3e302430 con 0x557f3e2f4620 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557f3e1f40b0 con 0x557f3e2ff800 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x557f3e3025b0 con 0x557f3e2f4f40 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 10 client.0 _ll_register_callbacks cb 0x557f3e1e1d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60918/0 (socket says 172.21.15.43:60918) 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 -- 172.21.15.43:0/3351658340 learned_addr learned my addr 172.21.15.43:0/3351658340 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f7475d9b640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f7476d9d640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e2fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 -- 172.21.15.43:0/3351658340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 msgr2=0x557f3e2fc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2fc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 -- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 msgr2=0x557f3e2fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e2fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 -- 172.21.15.43:0/3351658340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3e038620 con 0x557f3e2f4620 2024-04-25T20:52:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747659c640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7468003d30 tx=0x7f74680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb23103709ac9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f745dffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746802c060 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f7468017030 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.166+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7470004d20 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7468031480 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 10 client.15684 fetch_fsmap learned FSMap version 30 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f3e30e3c0 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7470004d20 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7468027710 con 0x557f3e2f4620 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 10 client.15684 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T20:52:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 20 client.15684 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e30f8d0 0x557f3e311d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 4 client.15684 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f3e267390 con 0x557f3e30f8d0 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.167+0000 7f7475d9b640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e30f8d0 0x557f3e311d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f745dffb640 10 client.15684 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f7475d9b640 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e30f8d0 0x557f3e311d00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=581ebd95b3e7f059 server_cookie=5783d9e3449dc6a1 in_seq=0 out_seq=0 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f745dffb640 1 -- 172.21.15.43:0/3351658340 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f3e267390 con 0x557f3e30f8d0 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f745dffb640 10 client.15684 handle_command_reply: tid=0 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f747f976740 1 client.15684 shutdown 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 msgr2=0x557f3e2ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.168+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7468003d30 tx=0x7f74680046c0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 shutdown_connections 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e30f8d0 0x557f3e311d00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2ff800 0x557f3e2fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e2fc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f745dffb640 0 client.15684 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 --2- 172.21.15.43:0/3351658340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e2ff150 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 >> 172.21.15.43:0/3351658340 conn(0x557f3e2f0b30 msgr2=0x557f3e2f6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 shutdown_connections 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 1 -- 172.21.15.43:0/3351658340 wait complete. 2024-04-25T20:52:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.169+0000 7f747f976740 20 client.15684 trim_cache size 0 max 16384 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 Processor -- start 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 -- start start 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4620 0x557f3e30b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e317610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74781adb10 con 0x557f3e2ff800 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74781af6b0 con 0x557f3e2f4620 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f747f976740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f74781ae1e0 con 0x557f3e2f4f40 2024-04-25T20:52:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.184+0000 7f7476d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60934/0 (socket says 172.21.15.43:60934) 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 -- 172.21.15.43:0/2046455881 learned_addr learned my addr 172.21.15.43:0/2046455881 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f747659c640 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4620 0x557f3e30b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e317610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 -- 172.21.15.43:0/2046455881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 msgr2=0x557f3e317610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e317610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 -- 172.21.15.43:0/2046455881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4620 msgr2=0x557f3e30b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4620 0x557f3e30b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 -- 172.21.15.43:0/2046455881 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3e2fc7a0 con 0x557f3e2ff800 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f70 tx=0x7f7470009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e24ab5aba72e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f745ffff640 1 -- 172.21.15.43:0/2046455881 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470016040 con 0x557f3e2ff800 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f745ffff640 1 -- 172.21.15.43:0/2046455881 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7470003d70 con 0x557f3e2ff800 2024-04-25T20:52:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.185+0000 7f745ffff640 1 -- 172.21.15.43:0/2046455881 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470024920 con 0x557f3e2ff800 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- 172.21.15.43:0/2046455881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 msgr2=0x557f3e317b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7470009f70 tx=0x7f7470009a40 comp rx=0 tx=0).stop 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- 172.21.15.43:0/2046455881 shutdown_connections 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2ff800 0x557f3e317b50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2f4f40 0x557f3e317610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 --2- 172.21.15.43:0/2046455881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4620 0x557f3e30b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- 172.21.15.43:0/2046455881 >> 172.21.15.43:0/2046455881 conn(0x557f3e2f0b30 msgr2=0x557f3e2efcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- 172.21.15.43:0/2046455881 shutdown_connections 2024-04-25T20:52:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- 172.21.15.43:0/2046455881 wait complete. 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 -- start start 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.186+0000 7f747f976740 1 Processor -- start 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 0x557f3e304d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2ff800 0x557f3e3052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74781aef80 con 0x557f3e2f4620 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f74781ae8b0 con 0x557f3e2f4f40 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f74781abb10 con 0x557f3e2ff800 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 10 client.0 _ll_register_callbacks cb 0x7f7468003bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60938/0 (socket says 172.21.15.43:60938) 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 -- 172.21.15.43:0/2119235099 learned_addr learned my addr 172.21.15.43:0/2119235099 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f7476d9d640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2ff800 0x557f3e3052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 0x557f3e304d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 -- 172.21.15.43:0/2119235099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2ff800 msgr2=0x557f3e3052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2ff800 0x557f3e3052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 -- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 msgr2=0x557f3e304d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 0x557f3e304d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 -- 172.21.15.43:0/2119235099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3e305860 con 0x557f3e2f4620 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 0x557f3e304d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747659c640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7468000c00 tx=0x7f74680052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc71114c748c87cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f745dffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004930 con 0x557f3e2f4620 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f7468004ad0 con 0x557f3e2f4620 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7470003d70 con 0x557f3e2f4620 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7468040050 con 0x557f3e2f4620 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 10 client.15690 fetch_fsmap learned FSMap version 30 2024-04-25T20:52:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.187+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f3e375c50 con 0x557f3e2f4620 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7470003d70 con 0x557f3e2f4620 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7468031af0 con 0x557f3e2f4620 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 10 client.15690 fetch_fsmap finished waiting for FSMap version 30 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 20 client.15690 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e376450 0x557f3e378870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 4 client.15690 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f3e261200 con 0x557f3e376450 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e376450 0x557f3e378870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f7475d9b640 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e376450 0x557f3e378870 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=122e7e028bec0886 server_cookie=1a58dda4171b9bbb in_seq=0 out_seq=0 2024-04-25T20:52:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.188+0000 7f745dffb640 10 client.15690 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.589+0000 7f745dffb640 1 -- 172.21.15.43:0/2119235099 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f3e261200 con 0x557f3e376450 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.589+0000 7f745dffb640 10 client.15690 handle_command_reply: tid=0 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.589+0000 7f747f976740 1 client.15690 shutdown 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 msgr2=0x557f3e307980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7468000c00 tx=0x7f74680052f0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 shutdown_connections 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x557f3e376450 0x557f3e378870 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f3e2ff800 0x557f3e3052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557f3e2f4f40 0x557f3e304d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 --2- 172.21.15.43:0/2119235099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f3e2f4620 0x557f3e307980 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 >> 172.21.15.43:0/2119235099 conn(0x557f3e2f0b30 msgr2=0x557f3e30a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f745dffb640 0 client.15690 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 shutdown_connections 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 1 -- 172.21.15.43:0/2119235099 wait complete. 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.590+0000 7f747f976740 20 client.15690 trim_cache size 0 max 16384 2024-04-25T20:52:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:52:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:52:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:52:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 msgr2=0x7f74600a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 0x7f74600a6280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557f3e2f5bc0 tx=0x7f746800b390 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 msgr2=0x7f7478199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f746c005940 tx=0x7f746c0042f0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 shutdown_connections 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f74600a3dc0 0x7f74600a6280 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f747819a090 0x7f74781a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7478106170 0x7f7478199ab0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 --2- 172.21.15.43:0/1458960097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74781010f0 0x7f7478199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 >> 172.21.15.43:0/1458960097 conn(0x7f7478077fd0 msgr2=0x7f74780fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 shutdown_connections 2024-04-25T20:52:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:27.591+0000 7f747cc69640 1 -- 172.21.15.43:0/1458960097 wait complete. 2024-04-25T20:52:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:27 smithi043 ceph-mon[29167]: pgmap v77: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 517 KiB/s wr, 31 op/s 2024-04-25T20:52:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:27 smithi195 ceph-mon[33250]: pgmap v77: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 517 KiB/s wr, 31 op/s 2024-04-25T20:52:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:27 smithi112 ceph-mon[32322]: pgmap v77: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 517 KiB/s wr, 31 op/s 2024-04-25T20:52:29.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:28 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:29.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:28 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:29.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:28 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:29.414 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar cf doc.tar linux-4.0.5 2024-04-25T20:52:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:29 smithi043 ceph-mon[29167]: pgmap v78: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 483 KiB/s wr, 18 op/s 2024-04-25T20:52:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:29 smithi195 ceph-mon[33250]: pgmap v78: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 483 KiB/s wr, 18 op/s 2024-04-25T20:52:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:29 smithi112 ceph-mon[32322]: pgmap v78: 97 pgs: 97 active+clean; 94 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 483 KiB/s wr, 18 op/s 2024-04-25T20:52:30.212 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xf doc.tar 2024-04-25T20:52:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:31 smithi043 ceph-mon[29167]: pgmap v79: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 786 KiB/s wr, 400 op/s 2024-04-25T20:52:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:31 smithi195 ceph-mon[33250]: pgmap v79: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 786 KiB/s wr, 400 op/s 2024-04-25T20:52:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:31 smithi112 ceph-mon[32322]: pgmap v79: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 786 KiB/s wr, 400 op/s 2024-04-25T20:52:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:33 smithi043 ceph-mon[29167]: pgmap v80: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 784 KiB/s wr, 396 op/s 2024-04-25T20:52:34.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:33 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:33 smithi195 ceph-mon[33250]: pgmap v80: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 784 KiB/s wr, 396 op/s 2024-04-25T20:52:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:33 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:33 smithi112 ceph-mon[32322]: pgmap v80: 97 pgs: 97 active+clean; 92 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 784 KiB/s wr, 396 op/s 2024-04-25T20:52:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:33 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:35 smithi043 ceph-mon[29167]: pgmap v81: 97 pgs: 97 active+clean; 125 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 558 op/s 2024-04-25T20:52:36.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:35 smithi195 ceph-mon[33250]: pgmap v81: 97 pgs: 97 active+clean; 125 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 558 op/s 2024-04-25T20:52:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:35 smithi112 ceph-mon[32322]: pgmap v81: 97 pgs: 97 active+clean; 125 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 558 op/s 2024-04-25T20:52:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:37 smithi043 ceph-mon[29167]: pgmap v82: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 614 op/s 2024-04-25T20:52:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:37 smithi195 ceph-mon[33250]: pgmap v82: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 614 op/s 2024-04-25T20:52:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:37 smithi112 ceph-mon[32322]: pgmap v82: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 614 op/s 2024-04-25T20:52:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:39 smithi043 ceph-mon[29167]: pgmap v83: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 613 op/s 2024-04-25T20:52:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:39 smithi195 ceph-mon[33250]: pgmap v83: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 613 op/s 2024-04-25T20:52:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:39 smithi112 ceph-mon[32322]: pgmap v83: 97 pgs: 97 active+clean; 137 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 613 op/s 2024-04-25T20:52:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 -- 172.21.15.43:0/483097705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 msgr2=0x7f069410ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 --2- 172.21.15.43:0/483097705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f069410ee80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f068c009ca0 tx=0x7f068c02a8c0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 -- 172.21.15.43:0/483097705 shutdown_connections 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 --2- 172.21.15.43:0/483097705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f069410ee80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 --2- 172.21.15.43:0/483097705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0694102b90 0x7f0694106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 --2- 172.21.15.43:0/483097705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06941021e0 0x7f06941025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 -- 172.21.15.43:0/483097705 >> 172.21.15.43:0/483097705 conn(0x7f06940fda00 msgr2=0x7f06940ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 -- 172.21.15.43:0/483097705 shutdown_connections 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.682+0000 7f069a14f640 1 -- 172.21.15.43:0/483097705 wait complete. 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 Processor -- start 2024-04-25T20:52:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 -- start start 2024-04-25T20:52:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 0x7f0694198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069419d010 0x7f069419d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0694112350 con 0x7f06941072b0 2024-04-25T20:52:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06941121d0 con 0x7f069419d010 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f069a14f640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f06941124d0 con 0x7f06941021e0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.683+0000 7f06937fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 0x7f0694198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41088/0 (socket says 172.21.15.43:41088) 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 -- 172.21.15.43:0/1928663558 learned_addr learned my addr 172.21.15.43:0/1928663558 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f06937fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 0x7f0694198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:34790/0 (socket says 172.21.15.43:34790) 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0693fff640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069419d010 0x7f069419d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 -- 172.21.15.43:0/1928663558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 msgr2=0x7f0694198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 0x7f0694198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 -- 172.21.15.43:0/1928663558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069419d010 msgr2=0x7f069419d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069419d010 0x7f069419d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 -- 172.21.15.43:0/1928663558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069419db00 con 0x7f06941072b0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0692ffd640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f068800e9f0 tx=0x7f068800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0690ff9640 1 -- 172.21.15.43:0/1928663558 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068800ccc0 con 0x7f06941072b0 2024-04-25T20:52:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0690ff9640 1 -- 172.21.15.43:0/1928663558 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06880054f0 con 0x7f06941072b0 2024-04-25T20:52:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069419ddf0 con 0x7f06941072b0 2024-04-25T20:52:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f0690ff9640 1 -- 172.21.15.43:0/1928663558 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688010690 con 0x7f06941072b0 2024-04-25T20:52:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.684+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06941a5590 con 0x7f06941072b0 2024-04-25T20:52:40.694 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.687+0000 7f0690ff9640 1 -- 172.21.15.43:0/1928663558 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f06880046c0 con 0x7f06941072b0 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.687+0000 7f069ce6c740 1 Processor -- start 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.687+0000 7f069ce6c740 1 -- start start 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x55691769f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569176aec10 0x5569176b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556917604970 con 0x5569176aec10 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5569175a14a0 con 0x55691769f520 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f069ce6c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x556917600930 con 0x55691769fe40 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569176aec10 0x5569176b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:34802/0 (socket says 172.21.15.43:34802) 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 -- 172.21.15.43:0/3968779109 learned_addr learned my addr 172.21.15.43:0/3968779109 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f0693fff640 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x55691769f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f0690ff9640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 0x7f067c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 -- 172.21.15.43:0/3968779109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 msgr2=0x55691769f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x55691769f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 -- 172.21.15.43:0/3968779109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569176aec10 msgr2=0x5569176b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569176aec10 0x5569176b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 -- 172.21.15.43:0/3968779109 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556917317210 con 0x55691769fe40 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f0693fff640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 0x7f067c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f0690ff9640 1 -- 172.21.15.43:0/1928663558 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f06880d0c10 con 0x7f06941072b0 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.688+0000 7f06937fe640 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f068400bd10 tx=0x7f06840107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e78558f92916e298 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f0679ffb640 1 -- 172.21.15.43:0/3968779109 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684004030 con 0x55691769fe40 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f0679ffb640 1 -- 172.21.15.43:0/3968779109 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06840041d0 con 0x55691769fe40 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f0679ffb640 1 -- 172.21.15.43:0/3968779109 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840118b0 con 0x55691769fe40 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f0693fff640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 0x7f067c0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f068c005e30 tx=0x7f068c0095c0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 -- 172.21.15.43:0/3968779109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 msgr2=0x5569176ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f068400bd10 tx=0x7f06840107a0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 -- 172.21.15.43:0/3968779109 shutdown_connections 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5569176aec10 0x5569176b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ae6d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 --2- 172.21.15.43:0/3968779109 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x55691769f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.689+0000 7f069ce6c740 1 -- 172.21.15.43:0/3968779109 >> 172.21.15.43:0/3968779109 conn(0x55691769bb30 msgr2=0x55691769bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- 172.21.15.43:0/3968779109 shutdown_connections 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- 172.21.15.43:0/3968779109 wait complete. 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- start start 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 Processor -- start 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x5569176ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569176aec10 0x5569176abd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5569176b1840 con 0x55691769fe40 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55691759f0b0 con 0x55691769f520 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5569176b19c0 con 0x5569176aec10 2024-04-25T20:52:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f069ce6c740 10 client.0 _ll_register_callbacks cb 0x55691758cd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.690+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41108/0 (socket says 172.21.15.43:41108) 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f06937fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x5569176ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 -- 172.21.15.43:0/2287506793 learned_addr learned my addr 172.21.15.43:0/2287506793 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0693fff640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569176aec10 0x5569176abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 -- 172.21.15.43:0/2287506793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569176aec10 msgr2=0x5569176abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569176aec10 0x5569176abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 -- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 msgr2=0x5569176ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x5569176ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 -- 172.21.15.43:0/2287506793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569173e3620 con 0x55691769fe40 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f06937fe640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x5569176ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0692ffd640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f06880ce3f0 tx=0x7f0688009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd11c4f4deefb0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0672ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068809c540 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f06880a53c0 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06840041d0 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f06880056a0 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f069ce6c740 10 client.15702 fetch_fsmap learned FSMap version 32 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569176bd880 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.691+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06840041d0 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f06880ceae0 con 0x55691769fe40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 10 client.15702 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 20 client.15702 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5569176bed40 0x5569176c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 4 client.15702 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556917612390 con 0x5569176bed40 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f06937fe640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5569176bed40 0x5569176c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f06937fe640 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5569176bed40 0x5569176c1130 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9ed1446afed9e6 server_cookie=2f1a31b885047c72 in_seq=0 out_seq=0 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.692+0000 7f0672ffd640 10 client.15702 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f0672ffd640 1 -- 172.21.15.43:0/2287506793 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556917612390 con 0x5569176bed40 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f0672ffd640 10 client.15702 handle_command_reply: tid=0 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 client.15702 shutdown 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 msgr2=0x5569176ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f06880ce3f0 tx=0x7f0688009310 comp rx=0 tx=0).stop 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 shutdown_connections 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5569176bed40 0x5569176c1130 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569176aec10 0x5569176abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176ab830 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 --2- 172.21.15.43:0/2287506793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55691769f520 0x5569176ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f0672ffd640 0 client.15702 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 >> 172.21.15.43:0/2287506793 conn(0x55691769bb30 msgr2=0x5569176a19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 shutdown_connections 2024-04-25T20:52:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 1 -- 172.21.15.43:0/2287506793 wait complete. 2024-04-25T20:52:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.693+0000 7f069ce6c740 20 client.15702 trim_cache size 0 max 16384 2024-04-25T20:52:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 Processor -- start 2024-04-25T20:52:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 -- start start 2024-04-25T20:52:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06941ab930 con 0x55691769f520 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06941ad530 con 0x5569176aec10 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f069ce6c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f06941ac000 con 0x55691769fe40 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41122/0 (socket says 172.21.15.43:41122) 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 -- 172.21.15.43:0/1453142651 learned_addr learned my addr 172.21.15.43:0/1453142651 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f0692ffd640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f0693fff640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 -- 172.21.15.43:0/1453142651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 msgr2=0x5569176ba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ba700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 -- 172.21.15.43:0/1453142651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 msgr2=0x5569176ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 -- 172.21.15.43:0/1453142651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556917697500 con 0x55691769f520 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f0692ffd640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f0693fff640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.709+0000 7f06937fe640 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0684011010 tx=0x7f068400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a9aab0a36501db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f06797fa640 1 -- 172.21.15.43:0/1453142651 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068402f070 con 0x55691769f520 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f06797fa640 1 -- 172.21.15.43:0/1453142651 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0684029170 con 0x55691769f520 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f06797fa640 1 -- 172.21.15.43:0/1453142651 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684003850 con 0x55691769f520 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 -- 172.21.15.43:0/1453142651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 msgr2=0x5569176abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0684011010 tx=0x7f068400bf90 comp rx=0 tx=0).stop 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 -- 172.21.15.43:0/1453142651 shutdown_connections 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769fe40 0x5569176ba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 --2- 172.21.15.43:0/1453142651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769f520 0x5569176abd50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 -- 172.21.15.43:0/1453142651 >> 172.21.15.43:0/1453142651 conn(0x55691769bb30 msgr2=0x5569176a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 -- 172.21.15.43:0/1453142651 shutdown_connections 2024-04-25T20:52:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.710+0000 7f069ce6c740 1 -- 172.21.15.43:0/1453142651 wait complete. 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 -- start start 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 Processor -- start 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769f520 0x5569176b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06941acda0 con 0x55691769fe40 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06941ac6d0 con 0x5569176aec10 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f06941a9910 con 0x55691769f520 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f069ce6c740 10 client.0 _ll_register_callbacks cb 0x7f068800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f06937fe640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769f520 0x5569176b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41124/0 (socket says 172.21.15.43:41124) 2024-04-25T20:52:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 -- 172.21.15.43:0/389404362 learned_addr learned my addr 172.21.15.43:0/389404362 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0693fff640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 -- 172.21.15.43:0/389404362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769f520 msgr2=0x5569176b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769f520 0x5569176b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 -- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 msgr2=0x5569176a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0692ffd640 1 -- 172.21.15.43:0/389404362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569177242b0 con 0x55691769fe40 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.711+0000 7f0693fff640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0692ffd640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0688099040 tx=0x7f0688004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92671c2d153b8db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06880d4250 con 0x55691769fe40 2024-04-25T20:52:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f06880bd0b0 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0684029170 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f068809c9b0 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 10 client.15708 fetch_fsmap learned FSMap version 32 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556917725310 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0684029170 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) ==== 8370+0+0 (secure 0 0 0) 0x7f0688061b60 con 0x55691769fe40 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 10 client.15708 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 20 client.15708 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556917725a30 0x556917727e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 4 client.15708 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:52:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.712+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55691760c200 con 0x556917725a30 2024-04-25T20:52:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.713+0000 7f06937fe640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556917725a30 0x556917727e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.713+0000 7f06937fe640 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556917725a30 0x556917727e50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c1cb9d8936ce0c server_cookie=59859f6c4135fd4a in_seq=0 out_seq=0 2024-04-25T20:52:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.713+0000 7f0672ffd640 10 client.15708 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f0672ffd640 1 -- 172.21.15.43:0/389404362 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55691760c200 con 0x556917725a30 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f0672ffd640 10 client.15708 handle_command_reply: tid=0 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 client.15708 shutdown 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 msgr2=0x5569176a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0688099040 tx=0x7f0688004a00 comp rx=0 tx=0).stop 2024-04-25T20:52:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 shutdown_connections 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x556917725a30 0x556917727e50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5569176aec10 0x5569176a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55691769fe40 0x5569176a8320 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f0672ffd640 0 client.15708 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 --2- 172.21.15.43:0/389404362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55691769f520 0x5569176b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 >> 172.21.15.43:0/389404362 conn(0x55691769bb30 msgr2=0x55691769a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.778+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 shutdown_connections 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069ce6c740 1 -- 172.21.15.43:0/389404362 wait complete. 2024-04-25T20:52:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069ce6c740 20 client.15708 trim_cache size 0 max 16384 2024-04-25T20:52:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:52:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:52:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:52:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:52:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 msgr2=0x7f067c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 0x7f067c0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f068c005e30 tx=0x7f068c0095c0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 msgr2=0x7f0694198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f068800e9f0 tx=0x7f068800eeb0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 shutdown_connections 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f067c0a3dc0 0x7f067c0a6280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f069419d010 0x7f069419d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06941072b0 0x7f0694198c90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.779+0000 7f069a14f640 1 --2- 172.21.15.43:0/1928663558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06941021e0 0x7f0694198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.780+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 >> 172.21.15.43:0/1928663558 conn(0x7f06940fda00 msgr2=0x7f06940fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.780+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 shutdown_connections 2024-04-25T20:52:40.782 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:40.780+0000 7f069a14f640 1 -- 172.21.15.43:0/1928663558 wait complete. 2024-04-25T20:52:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:41 smithi043 ceph-mon[29167]: pgmap v84: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 757 op/s 2024-04-25T20:52:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:41 smithi195 ceph-mon[33250]: pgmap v84: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 757 op/s 2024-04-25T20:52:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:41 smithi112 ceph-mon[32322]: pgmap v84: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.1 MiB/s wr, 757 op/s 2024-04-25T20:52:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:43 smithi043 ceph-mon[29167]: pgmap v85: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-04-25T20:52:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:43 smithi195 ceph-mon[33250]: pgmap v85: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-04-25T20:52:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:43 smithi112 ceph-mon[32322]: pgmap v85: 97 pgs: 97 active+clean; 146 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 374 op/s 2024-04-25T20:52:45.881 INFO:tasks.workunit.client.0.smithi043.stderr:+ sync 2024-04-25T20:52:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:45 smithi043 ceph-mon[29167]: pgmap v86: 97 pgs: 97 active+clean; 150 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 457 op/s 2024-04-25T20:52:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:45 smithi195 ceph-mon[33250]: pgmap v86: 97 pgs: 97 active+clean; 150 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 457 op/s 2024-04-25T20:52:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:45 smithi112 ceph-mon[32322]: pgmap v86: 97 pgs: 97 active+clean; 150 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 457 op/s 2024-04-25T20:52:47.594 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar c linux-4.0.5 2024-04-25T20:52:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:47 smithi043 ceph-mon[29167]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 325 op/s 2024-04-25T20:52:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:47 smithi195 ceph-mon[33250]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 325 op/s 2024-04-25T20:52:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:47 smithi112 ceph-mon[32322]: pgmap v87: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 325 op/s 2024-04-25T20:52:48.128 INFO:tasks.workunit.client.0.smithi043.stderr:+ rm -rf linux-4.0.5 2024-04-25T20:52:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:49 smithi043 ceph-mon[29167]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-04-25T20:52:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:49 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:49 smithi195 ceph-mon[33250]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-04-25T20:52:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:49 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:49 smithi112 ceph-mon[32322]: pgmap v88: 97 pgs: 97 active+clean; 150 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-04-25T20:52:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:49 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:51 smithi043 ceph-mon[29167]: pgmap v89: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 662 op/s 2024-04-25T20:52:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:51 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:51 smithi195 ceph-mon[33250]: pgmap v89: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 662 op/s 2024-04-25T20:52:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:51 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:51 smithi112 ceph-mon[32322]: pgmap v89: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 662 op/s 2024-04-25T20:52:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:51 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:53.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:52 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:53.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:52 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:53.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:52 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 -- 172.21.15.43:0/658165766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c810c560 msgr2=0x7f71c810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/658165766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c810c560 0x7f71c810e9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009ca0 tx=0x7f71c002a950 comp rx=0 tx=0).stop 2024-04-25T20:52:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 -- 172.21.15.43:0/658165766 shutdown_connections 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/658165766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c810c560 0x7f71c810e9b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/658165766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 0x7f71c810c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/658165766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c8103220 0x7f71c8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 -- 172.21.15.43:0/658165766 >> 172.21.15.43:0/658165766 conn(0x7f71c8077fd0 msgr2=0x7f71c80783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.909+0000 7f71ce7e5640 1 -- 172.21.15.43:0/658165766 shutdown_connections 2024-04-25T20:52:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.910+0000 7f71ce7e5640 1 -- 172.21.15.43:0/658165766 wait complete. 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.910+0000 7f71ce7e5640 1 Processor -- start 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.910+0000 7f71ce7e5640 1 -- start start 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 0x7f71c81013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c810c560 0x7f71c81018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81122e0 con 0x7f71c8103b40 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8112160 con 0x7f71c810c560 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ce7e5640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8112460 con 0x7f71c8103220 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:44838/0 (socket says 172.21.15.43:44838) 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 -- 172.21.15.43:0/2405434281 learned_addr learned my addr 172.21.15.43:0/2405434281 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c77fe640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 0x7f71c81013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71ccd82640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c810c560 0x7f71c81018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 -- 172.21.15.43:0/2405434281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c810c560 msgr2=0x7f71c81018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c810c560 0x7f71c81018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 -- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 msgr2=0x7f71c81013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 0x7f71c81013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.911+0000 7f71c7fff640 1 -- 172.21.15.43:0/2405434281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c81a6ca0 con 0x7f71c8103220 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71c7fff640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71b800e9f0 tx=0x7f71b800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71c57fa640 1 -- 172.21.15.43:0/2405434281 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b800cd80 con 0x7f71c8103220 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71c57fa640 1 -- 172.21.15.43:0/2405434281 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71b80054f0 con 0x7f71c8103220 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c81a6f90 con 0x7f71c8103220 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71c57fa640 1 -- 172.21.15.43:0/2405434281 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8010690 con 0x7f71c8103220 2024-04-25T20:52:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.912+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c81a73f0 con 0x7f71c8103220 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71c57fa640 1 -- 172.21.15.43:0/2405434281 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f71b80046c0 con 0x7f71c8103220 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 Processor -- start 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 -- start start 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b3640da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b3641abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562b36372970 con 0x562b3640df40 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562b3630f4a0 con 0x562b36418800 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71d15dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x562b3636e930 con 0x562b3640d620 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.915+0000 7f71c57fa640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 0x7f71b00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60616/0 (socket says 172.21.15.43:60616) 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c7fff640 1 -- 172.21.15.43:0/1550303986 learned_addr learned my addr 172.21.15.43:0/1550303986 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b3641abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b3640da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ccd82640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 0x7f71b00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c57fa640 1 -- 172.21.15.43:0/2405434281 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f71b80d0b30 con 0x7f71c8103220 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 -- 172.21.15.43:0/1550303986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 msgr2=0x562b3640da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b3640da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 -- 172.21.15.43:0/1550303986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 msgr2=0x562b364182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 -- 172.21.15.43:0/1550303986 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b36085210 con 0x562b36418800 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c7fff640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:52:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b3640da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:52:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ccd82640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 0x7f71b00a6280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009430 tx=0x7f71c0005c50 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b3641abf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009bf0 tx=0x7f71bc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b0cee186fcf387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ae7fc640 1 -- 172.21.15.43:0/1550303986 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc004050 con 0x562b36418800 2024-04-25T20:52:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ae7fc640 1 -- 172.21.15.43:0/1550303986 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71bc0054f0 con 0x562b36418800 2024-04-25T20:52:53.919 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.916+0000 7f71ae7fc640 1 -- 172.21.15.43:0/1550303986 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc004d40 con 0x562b36418800 2024-04-25T20:52:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- 172.21.15.43:0/1550303986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 msgr2=0x562b3641abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b3641abf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009bf0 tx=0x7f71bc011810 comp rx=0 tx=0).stop 2024-04-25T20:52:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- 172.21.15.43:0/1550303986 shutdown_connections 2024-04-25T20:52:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b3641abf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b364182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1550303986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b3640da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- 172.21.15.43:0/1550303986 >> 172.21.15.43:0/1550303986 conn(0x562b36409b30 msgr2=0x562b36409f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- 172.21.15.43:0/1550303986 shutdown_connections 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- 172.21.15.43:0/1550303986 wait complete. 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.917+0000 7f71d15dc740 1 -- start start 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 Processor -- start 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b36418080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b364158b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562b3641b430 con 0x562b3640df40 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562b3630d0b0 con 0x562b36418800 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x562b3641b5b0 con 0x562b3640d620 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71d15dc740 10 client.0 _ll_register_callbacks cb 0x562b362fad30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b36418080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60628/0 (socket says 172.21.15.43:60628) 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71c77fe640 1 -- 172.21.15.43:0/1234713585 learned_addr learned my addr 172.21.15.43:0/1234713585 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.918+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b364158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 -- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 msgr2=0x562b364158b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b364158b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 -- 172.21.15.43:0/1234713585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 msgr2=0x562b36415370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 -- 172.21.15.43:0/1234713585 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b36151620 con 0x562b3640d620 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b364158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71c7fff640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b36418080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562b3640ebc0 tx=0x7f71b8004a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbac053f468ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2024-04-25T20:52:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b809d200 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71bc0054f0 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f71b80a52e0 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f71b809cb00 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71d15dc740 10 client.25306 fetch_fsmap learned FSMap version 36 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562b36427310 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.919+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71bc0054f0 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 36) ==== 8394+0+0 (secure 0 0 0) 0x7f71b8098850 con 0x562b3640d620 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 10 client.25306 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T20:52:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 10 client.25306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 20 client.25306 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b364288a0 0x562b3642acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 4 client.25306 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b36380390 con 0x562b364288a0 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b364288a0 0x562b3642acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71a77fe640 10 client.25306 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.920+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b364288a0 0x562b3642acb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e78b71b34a1ad2 server_cookie=1504902a6917c2ff in_seq=0 out_seq=0 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71a77fe640 1 -- 172.21.15.43:0/1234713585 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562b36380390 con 0x562b364288a0 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71a77fe640 10 client.25306 handle_command_reply: tid=0 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 client.25306 shutdown 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 msgr2=0x562b36418080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b36418080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562b3640ebc0 tx=0x7f71b8004a70 comp rx=0 tx=0).stop 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 shutdown_connections 2024-04-25T20:52:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b364288a0 0x562b3642acb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b36418800 0x562b364158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36415370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1234713585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b36418080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 >> 172.21.15.43:0/1234713585 conn(0x562b36409b30 msgr2=0x562b3640f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71a77fe640 0 client.25306 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 shutdown_connections 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 1 -- 172.21.15.43:0/1234713585 wait complete. 2024-04-25T20:52:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.921+0000 7f71d15dc740 20 client.25306 trim_cache size 0 max 16384 2024-04-25T20:52:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.936+0000 7f71d15dc740 1 Processor -- start 2024-04-25T20:52:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.936+0000 7f71d15dc740 1 -- start start 2024-04-25T20:52:53.941 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b364242f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640df40 0x562b36417bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81afca0 con 0x562b36418800 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81b1990 con 0x562b3640df40 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71d15dc740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81b0370 con 0x562b3640d620 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60644/0 (socket says 172.21.15.43:60644) 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 -- 172.21.15.43:0/1457878572 learned_addr learned my addr 172.21.15.43:0/1457878572 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:53.942 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71c7fff640 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b364242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71c77fe640 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640df40 0x562b36417bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 -- 172.21.15.43:0/1457878572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 msgr2=0x562b364242f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b364242f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 -- 172.21.15.43:0/1457878572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640df40 msgr2=0x562b36417bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640df40 0x562b36417bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 -- 172.21.15.43:0/1457878572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b36405500 con 0x562b36418800 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71ccd82640 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009ca0 tx=0x7f71c0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c70048eeaf3937 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71adffb640 1 -- 172.21.15.43:0/1457878572 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0034040 con 0x562b36418800 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71adffb640 1 -- 172.21.15.43:0/1457878572 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71c0004710 con 0x562b36418800 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.937+0000 7f71adffb640 1 -- 172.21.15.43:0/1457878572 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0030c70 con 0x562b36418800 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- 172.21.15.43:0/1457878572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 msgr2=0x562b36430580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009ca0 tx=0x7f71c0009360 comp rx=0 tx=0).stop 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- 172.21.15.43:0/1457878572 shutdown_connections 2024-04-25T20:52:53.943 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b36418800 0x562b36430580 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640df40 0x562b36417bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 --2- 172.21.15.43:0/1457878572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b3640d620 0x562b364242f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- 172.21.15.43:0/1457878572 >> 172.21.15.43:0/1457878572 conn(0x562b36409b30 msgr2=0x562b36408cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- 172.21.15.43:0/1457878572 shutdown_connections 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- 172.21.15.43:0/1457878572 wait complete. 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.938+0000 7f71d15dc740 1 -- start start 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 Processor -- start 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640d620 0x562b36420cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b36418800 0x562b36412f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60658/0 (socket says 172.21.15.43:60658) 2024-04-25T20:52:53.944 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 -- 172.21.15.43:0/475246216 learned_addr learned my addr 172.21.15.43:0/475246216 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81b1200 con 0x562b3640df40 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81b0a70 con 0x562b3640d620 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f71c81adc80 con 0x562b36418800 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c7fff640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640d620 0x562b36420cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71d15dc740 10 client.0 _ll_register_callbacks cb 0x562b362fad30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 -- 172.21.15.43:0/475246216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b36418800 msgr2=0x562b36412f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b36418800 0x562b36412f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 -- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640d620 msgr2=0x562b36420cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640d620 0x562b36420cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b36411770 con 0x562b3640df40 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71c77fe640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009f20 tx=0x7f71bc005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2367d1f4603f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.939+0000 7f71a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc02ebd0 con 0x562b3640df40 2024-04-25T20:52:53.945 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f71bc02ed70 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71c0004710 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f71bc02e420 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 10 client.15726 fetch_fsmap learned FSMap version 36 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562b3648e240 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71c0004710 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 36) ==== 8394+0+0 (secure 0 0 0) 0x7f71bc003cc0 con 0x562b3640df40 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 10 client.15726 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 20 client.15726 populate_metadata read hostname 'smithi043' 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b3648e7c0 0x562b36490be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 4 client.15726 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b3637a200 con 0x562b3648e7c0 2024-04-25T20:52:53.946 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.940+0000 7f71c7fff640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b3648e7c0 0x562b36490be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:52:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.941+0000 7f71a77fe640 10 client.15726 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:53.947 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:53.941+0000 7f71c7fff640 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b3648e7c0 0x562b36490be0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=486b040fb2046bdc server_cookie=2059ad7a3db237bf in_seq=0 out_seq=0 2024-04-25T20:52:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:53 smithi043 ceph-mon[29167]: pgmap v90: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 518 op/s 2024-04-25T20:52:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:53 smithi195 ceph-mon[33250]: pgmap v90: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 518 op/s 2024-04-25T20:52:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:53 smithi112 ceph-mon[32322]: pgmap v90: 97 pgs: 97 active+clean; 175 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 518 op/s 2024-04-25T20:52:54.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71a77fe640 1 -- 172.21.15.43:0/475246216 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b3637a200 con 0x562b3648e7c0 2024-04-25T20:52:54.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71a77fe640 10 client.15726 handle_command_reply: tid=0 2024-04-25T20:52:54.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 client.15726 shutdown 2024-04-25T20:52:54.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 msgr2=0x562b36412950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:54.169 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009f20 tx=0x7f71bc005a70 comp rx=0 tx=0).stop 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 shutdown_connections 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x562b3648e7c0 0x562b36490be0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b36418800 0x562b36412f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562b3640df40 0x562b36412950 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71a77fe640 0 client.15726 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 --2- 172.21.15.43:0/475246216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562b3640d620 0x562b36420cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 >> 172.21.15.43:0/475246216 conn(0x562b36409b30 msgr2=0x562b36414c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 shutdown_connections 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 1 -- 172.21.15.43:0/475246216 wait complete. 2024-04-25T20:52:54.170 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.168+0000 7f71d15dc740 20 client.15726 trim_cache size 0 max 16384 2024-04-25T20:52:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:52:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:52:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:52:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 msgr2=0x7f71b00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 0x7f71b00a6280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009430 tx=0x7f71c0005c50 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 msgr2=0x7f71c8100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71b800e9f0 tx=0x7f71b800edf0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 shutdown_connections 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f71b00a3dc0 0x7f71b00a6280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71c810c560 0x7f71c81018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71c8103b40 0x7f71c81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 --2- 172.21.15.43:0/2405434281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c8103220 0x7f71c8100e70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 >> 172.21.15.43:0/2405434281 conn(0x7f71c8077fd0 msgr2=0x7f71c80ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 shutdown_connections 2024-04-25T20:52:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:52:54.169+0000 7f71ce7e5640 1 -- 172.21.15.43:0/2405434281 wait complete. 2024-04-25T20:52:55.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:54 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:55.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:54 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:54 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:55 smithi043 ceph-mon[29167]: pgmap v91: 97 pgs: 97 active+clean; 177 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 700 op/s 2024-04-25T20:52:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:55 smithi195 ceph-mon[33250]: pgmap v91: 97 pgs: 97 active+clean; 177 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 700 op/s 2024-04-25T20:52:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:55 smithi112 ceph-mon[32322]: pgmap v91: 97 pgs: 97 active+clean; 177 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 700 op/s 2024-04-25T20:52:57.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:56 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:57.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:56 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:57.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:56 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:57 smithi195 ceph-mon[33250]: pgmap v92: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 692 op/s 2024-04-25T20:52:58.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:57 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:57 smithi112 ceph-mon[32322]: pgmap v92: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 692 op/s 2024-04-25T20:52:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:57 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:58.195 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:57 smithi043 ceph-mon[29167]: pgmap v92: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 692 op/s 2024-04-25T20:52:58.195 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:57 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:59.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:58 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:58 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:52:59.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:58 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:00.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:52:59 smithi195 ceph-mon[33250]: pgmap v93: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 662 op/s 2024-04-25T20:53:00.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:52:59 smithi112 ceph-mon[32322]: pgmap v93: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 662 op/s 2024-04-25T20:53:00.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:52:59 smithi043 ceph-mon[29167]: pgmap v93: 97 pgs: 97 active+clean; 177 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 662 op/s 2024-04-25T20:53:01.160 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar xf doc.tar 2024-04-25T20:53:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:01 smithi195 ceph-mon[33250]: pgmap v94: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-04-25T20:53:02.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:01 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:01 smithi112 ceph-mon[32322]: pgmap v94: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-04-25T20:53:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:01 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:02.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:01 smithi043 ceph-mon[29167]: pgmap v94: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-04-25T20:53:02.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:01 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:03.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:02 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:03.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:02 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:03.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:02 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:03 smithi195 ceph-mon[33250]: pgmap v95: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-04-25T20:53:04.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:03 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:03 smithi112 ceph-mon[32322]: pgmap v95: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-04-25T20:53:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:03 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:03 smithi043 ceph-mon[29167]: pgmap v95: 97 pgs: 97 active+clean; 178 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 374 op/s 2024-04-25T20:53:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:03 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:53:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:05 smithi112 ceph-mon[32322]: pgmap v96: 97 pgs: 97 active+clean; 179 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 471 op/s 2024-04-25T20:53:06.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:05 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:53:06.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:05 smithi043 ceph-mon[29167]: pgmap v96: 97 pgs: 97 active+clean; 179 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 471 op/s 2024-04-25T20:53:06.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:05 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:53:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:05 smithi195 ceph-mon[33250]: pgmap v96: 97 pgs: 97 active+clean; 179 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 471 op/s 2024-04-25T20:53:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:05 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:53:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 -- 172.21.15.43:0/2455969500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c1010e0 msgr2=0x7f4f6c1014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 --2- 172.21.15.43:0/2455969500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c1014c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009900 tx=0x7f4f5c02a410 comp rx=0 tx=0).stop 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 -- 172.21.15.43:0/2455969500 shutdown_connections 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 --2- 172.21.15.43:0/2455969500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 0x7f4f6c10dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 --2- 172.21.15.43:0/2455969500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c101a90 0x7f4f6c105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 --2- 172.21.15.43:0/2455969500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c1014c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 -- 172.21.15.43:0/2455969500 >> 172.21.15.43:0/2455969500 conn(0x7f4f6c0771d0 msgr2=0x7f4f6c0775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 -- 172.21.15.43:0/2455969500 shutdown_connections 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.267+0000 7f4f713a2640 1 -- 172.21.15.43:0/2455969500 wait complete. 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 Processor -- start 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 -- start start 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 0x7f4f6c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c111250 con 0x7f4f6c19cf70 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1110d0 con 0x7f4f6c1010e0 2024-04-25T20:53:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f713a2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1113d0 con 0x7f4f6c1061b0 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f6b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43184/0 (socket says 172.21.15.43:43184) 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f6b7fe640 1 -- 172.21.15.43:0/127640862 learned_addr learned my addr 172.21.15.43:0/127640862 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.268+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 0x7f4f6c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6affd640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 -- 172.21.15.43:0/127640862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 msgr2=0x7f4f6c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 0x7f4f6c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 -- 172.21.15.43:0/127640862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c1010e0 msgr2=0x7f4f6c198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 -- 172.21.15.43:0/127640862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c19da60 con 0x7f4f6c19cf70 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f6b7fe640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400eaa0 tx=0x7f4f6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f63fff640 1 -- 172.21.15.43:0/127640862 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f64004d20 con 0x7f4f6c19cf70 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f63fff640 1 -- 172.21.15.43:0/127640862 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f64005020 con 0x7f4f6c19cf70 2024-04-25T20:53:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f63fff640 1 -- 172.21.15.43:0/127640862 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f640116d0 con 0x7f4f6c19cf70 2024-04-25T20:53:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c19dd50 con 0x7f4f6c19cf70 2024-04-25T20:53:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.269+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c1a54f0 con 0x7f4f6c19cf70 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.272+0000 7f4f63fff640 1 -- 172.21.15.43:0/127640862 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4f640051d0 con 0x7f4f6c19cf70 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.272+0000 7f4f74197740 1 Processor -- start 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.272+0000 7f4f74197740 1 -- start start 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5602590c5970 con 0x560259160f40 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602590624a0 con 0x560259160620 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f74197740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x5602590c1930 con 0x56025916b800 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43194/0 (socket says 172.21.15.43:43194) 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 -- 172.21.15.43:0/1512884688 learned_addr learned my addr 172.21.15.43:0/1512884688 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f63fff640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 0x7f4f580a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6b7fe640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 0x7f4f580a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 -- 172.21.15.43:0/1512884688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 msgr2=0x56025916dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 -- 172.21.15.43:0/1512884688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 msgr2=0x560259160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f6affd640 1 -- 172.21.15.43:0/1512884688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560258dd8210 con 0x560259160f40 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.273+0000 7f4f63fff640 1 -- 172.21.15.43:0/127640862 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f640d09b0 con 0x7f4f6c19cf70 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.274+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009900 tx=0x7f4f5c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa198c1fbe195b46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.274+0000 7f4f6b7fe640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 0x7f4f580a6280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f64099350 tx=0x7f4f64089040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.274+0000 7f4f617fa640 1 -- 172.21.15.43:0/1512884688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c03f070 con 0x560259160f40 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.274+0000 7f4f617fa640 1 -- 172.21.15.43:0/1512884688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f5c004030 con 0x560259160f40 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.274+0000 7f4f617fa640 1 -- 172.21.15.43:0/1512884688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c035070 con 0x560259160f40 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- 172.21.15.43:0/1512884688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 msgr2=0x56025916b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009900 tx=0x7f4f5c032c80 comp rx=0 tx=0).stop 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- 172.21.15.43:0/1512884688 shutdown_connections 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916b2c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 --2- 172.21.15.43:0/1512884688 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- 172.21.15.43:0/1512884688 >> 172.21.15.43:0/1512884688 conn(0x56025915cb30 msgr2=0x56025915cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- 172.21.15.43:0/1512884688 shutdown_connections 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- 172.21.15.43:0/1512884688 wait complete. 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 -- start start 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.275+0000 7f4f74197740 1 Processor -- start 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160f40 0x560259168420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x560259168960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56025916e3d0 con 0x560259160620 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602590600b0 con 0x560259160f40 2024-04-25T20:53:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56025916e550 con 0x56025916b800 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 10 client.0 _ll_register_callbacks cb 0x56025904dd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43198/0 (socket says 172.21.15.43:43198) 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/3835604417 learned_addr learned my addr 172.21.15.43:0/3835604417 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6affd640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160f40 0x560259168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/3835604417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 msgr2=0x560259168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x560259168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160f40 msgr2=0x560259168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160f40 0x560259168420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/3835604417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560258ea4620 con 0x560259160620 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400a380 tx=0x7f4f5400a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6731bc22489a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f527fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54021020 con 0x560259160620 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f54005020 con 0x560259160620 2024-04-25T20:53:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f5c004030 con 0x560259160620 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.276+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4f54005220 con 0x560259160620 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 10 client.15738 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56025917a340 con 0x560259160620 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f5c004030 con 0x560259160620 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f4f5400e570 con 0x560259160620 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 10 client.15738 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 20 client.15738 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56025917b850 0x56025917dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 4 client.15738 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602590d3390 con 0x56025917b850 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.277+0000 7f4f6affd640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56025917b850 0x56025917dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.278+0000 7f4f527fc640 10 client.15738 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.278+0000 7f4f6affd640 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56025917b850 0x56025917dcd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97b7636732e31996 server_cookie=7a543a51763255c8 in_seq=0 out_seq=0 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.278+0000 7f4f527fc640 1 -- 172.21.15.43:0/3835604417 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5602590d3390 con 0x56025917b850 2024-04-25T20:53:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.278+0000 7f4f527fc640 10 client.15738 handle_command_reply: tid=0 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.278+0000 7f4f74197740 1 client.15738 shutdown 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 msgr2=0x56025916b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400a380 tx=0x7f4f5400a3b0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 shutdown_connections 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x56025917b850 0x56025917dcd0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x560259168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160f40 0x560259168420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f527fc640 0 client.15738 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 --2- 172.21.15.43:0/3835604417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160620 0x56025916b130 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 >> 172.21.15.43:0/3835604417 conn(0x56025915cb30 msgr2=0x5602591628b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 shutdown_connections 2024-04-25T20:53:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 1 -- 172.21.15.43:0/3835604417 wait complete. 2024-04-25T20:53:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.279+0000 7f4f74197740 20 client.15738 trim_cache size 0 max 16384 2024-04-25T20:53:07.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:53:07.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:53:07.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:53:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 Processor -- start 2024-04-25T20:53:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 -- start start 2024-04-25T20:53:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56025916b800 0x5602591835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.294+0000 7f4f74197740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1adaf0 con 0x560259160f40 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f74197740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1af930 con 0x56025916b800 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f74197740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1ae280 con 0x560259160620 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:54360/0 (socket says 172.21.15.43:54360) 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/2165348646 learned_addr learned my addr 172.21.15.43:0/2165348646 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56025916b800 0x5602591835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/2165348646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56025916b800 msgr2=0x5602591835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56025916b800 0x5602591835e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/2165348646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 msgr2=0x56025916ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 -- 172.21.15.43:0/2165348646 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560259168cc0 con 0x560259160620 2024-04-25T20:53:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f540118c0 tx=0x7f4f5400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb14c7bbb6701af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f60ff9640 1 -- 172.21.15.43:0/2165348646 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54021040 con 0x560259160620 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f60ff9640 1 -- 172.21.15.43:0/2165348646 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f5400ec00 con 0x560259160620 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.295+0000 7f4f60ff9640 1 -- 172.21.15.43:0/2165348646 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54004c40 con 0x560259160620 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- 172.21.15.43:0/2165348646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 msgr2=0x560259177290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f540118c0 tx=0x7f4f5400a2d0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- 172.21.15.43:0/2165348646 shutdown_connections 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56025916b800 0x5602591835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 --2- 172.21.15.43:0/2165348646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560259160620 0x560259177290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- 172.21.15.43:0/2165348646 >> 172.21.15.43:0/2165348646 conn(0x56025915cb30 msgr2=0x56025915bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- 172.21.15.43:0/2165348646 shutdown_connections 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- 172.21.15.43:0/2165348646 wait complete. 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.296+0000 7f4f74197740 1 -- start start 2024-04-25T20:53:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 Processor -- start 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259173a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1af1a0 con 0x560259160f40 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1aea10 con 0x560259160620 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1abad0 con 0x56025916b800 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f74197740 10 client.0 _ll_register_callbacks cb 0x7f4f54011b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:43216/0 (socket says 172.21.15.43:43216) 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 -- 172.21.15.43:0/1748477549 learned_addr learned my addr 172.21.15.43:0/1748477549 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 -- 172.21.15.43:0/1748477549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 msgr2=0x56025916f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 -- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 msgr2=0x560259173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 -- 172.21.15.43:0/1748477549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56025916f9d0 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f6affd640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c005430 tx=0x7f4f5c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c739140d4bc5cf99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.297+0000 7f4f527fc640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c052070 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f4f5c004460 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f5400ec00 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4f5c05e050 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 10 client.15744 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5602591e1d00 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f5400ec00 con 0x560259160f40 2024-04-25T20:53:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f4f5c03b430 con 0x560259160f40 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 10 client.15744 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 10 client.15744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 20 client.15744 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5602591e20f0 0x5602591e4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 4 client.15744 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.298+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602590cd200 con 0x5602591e20f0 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.299+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5602591e20f0 0x5602591e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.299+0000 7f4f6a7fc640 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5602591e20f0 0x5602591e4510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=562237dd687bdd7a server_cookie=5710968ca7d70baa in_seq=0 out_seq=0 2024-04-25T20:53:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:07.299+0000 7f4f527fc640 10 client.15744 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:07.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:53:07.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:53:07.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:53:07.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:53:07.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:53:07.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:53:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f527fc640 1 -- 172.21.15.43:0/1748477549 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602590cd200 con 0x5602591e20f0 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f527fc640 10 client.15744 handle_command_reply: tid=0 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 client.15744 shutdown 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 msgr2=0x56025916eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c005430 tx=0x7f4f5c0058b0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 shutdown_connections 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x5602591e20f0 0x5602591e4510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56025916b800 0x56025916f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f527fc640 0 client.15744 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560259160f40 0x56025916eda0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 --2- 172.21.15.43:0/1748477549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560259160620 0x560259173a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 >> 172.21.15.43:0/1748477549 conn(0x56025915cb30 msgr2=0x56025915b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 shutdown_connections 2024-04-25T20:53:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 1 -- 172.21.15.43:0/1748477549 wait complete. 2024-04-25T20:53:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.210+0000 7f4f74197740 20 client.15744 trim_cache size 0 max 16384 2024-04-25T20:53:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:53:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:53:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:53:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 msgr2=0x7f4f580a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 0x7f4f580a6280 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f64099350 tx=0x7f4f64089040 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 msgr2=0x7f4f6c19d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400eaa0 tx=0x7f4f6400eea0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 shutdown_connections 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f4f580a3dc0 0x7f4f580a6280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f6c19cf70 0x7f4f6c19d420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c1061b0 0x7f4f6c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 --2- 172.21.15.43:0/127640862 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f6c1010e0 0x7f4f6c198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 >> 172.21.15.43:0/127640862 conn(0x7f4f6c0771d0 msgr2=0x7f4f6c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.211+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 shutdown_connections 2024-04-25T20:53:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:08.212+0000 7f4f713a2640 1 -- 172.21.15.43:0/127640862 wait complete. 2024-04-25T20:53:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:07 smithi043 ceph-mon[29167]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 324 op/s 2024-04-25T20:53:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:07 smithi195 ceph-mon[33250]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 324 op/s 2024-04-25T20:53:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:07 smithi112 ceph-mon[32322]: pgmap v97: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 324 op/s 2024-04-25T20:53:10.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:09 smithi043 ceph-mon[29167]: pgmap v98: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2024-04-25T20:53:10.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:09 smithi195 ceph-mon[33250]: pgmap v98: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2024-04-25T20:53:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:09 smithi112 ceph-mon[32322]: pgmap v98: 97 pgs: 97 active+clean; 178 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2024-04-25T20:53:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:+ sync 2024-04-25T20:53:12.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:11 smithi043 ceph-mon[29167]: pgmap v99: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 867 op/s 2024-04-25T20:53:12.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:11 smithi195 ceph-mon[33250]: pgmap v99: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 867 op/s 2024-04-25T20:53:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:11 smithi112 ceph-mon[32322]: pgmap v99: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 867 op/s 2024-04-25T20:53:14.031 INFO:tasks.workunit.client.0.smithi043.stderr:+ tar c linux-4.0.5 2024-04-25T20:53:14.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:13 smithi043 ceph-mon[29167]: pgmap v100: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 750 op/s 2024-04-25T20:53:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:13 smithi195 ceph-mon[33250]: pgmap v100: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 750 op/s 2024-04-25T20:53:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:13 smithi112 ceph-mon[32322]: pgmap v100: 97 pgs: 97 active+clean; 175 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 750 op/s 2024-04-25T20:53:14.676 INFO:tasks.workunit.client.0.smithi043.stdout:Ok 2024-04-25T20:53:14.677 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo Ok 2024-04-25T20:53:14.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T20:53:14.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T20:53:16.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:15 smithi043 ceph-mon[29167]: pgmap v101: 97 pgs: 97 active+clean; 200 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 984 op/s 2024-04-25T20:53:16.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:15 smithi195 ceph-mon[33250]: pgmap v101: 97 pgs: 97 active+clean; 200 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 984 op/s 2024-04-25T20:53:16.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:15 smithi112 ceph-mon[32322]: pgmap v101: 97 pgs: 97 active+clean; 200 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 984 op/s 2024-04-25T20:53:18.143 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:17 smithi195 ceph-mon[33250]: pgmap v102: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-04-25T20:53:18.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:17 smithi043 ceph-mon[29167]: pgmap v102: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-04-25T20:53:18.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:17 smithi112 ceph-mon[32322]: pgmap v102: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-04-25T20:53:20.144 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:19 smithi112 ceph-mon[32322]: pgmap v103: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 944 op/s 2024-04-25T20:53:20.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:19 smithi043 ceph-mon[29167]: pgmap v103: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 944 op/s 2024-04-25T20:53:20.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:19 smithi195 ceph-mon[33250]: pgmap v103: 97 pgs: 97 active+clean; 206 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 944 op/s 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 -- 172.21.15.43:0/395719458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401006c0 msgr2=0x7fc340100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 --2- 172.21.15.43:0/395719458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401006c0 0x7fc340100aa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc330009900 tx=0x7fc33002a410 comp rx=0 tx=0).stop 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 -- 172.21.15.43:0/395719458 shutdown_connections 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 --2- 172.21.15.43:0/395719458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc340107280 0x7fc34010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 --2- 172.21.15.43:0/395719458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340101070 0x7fc340106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 --2- 172.21.15.43:0/395719458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3401006c0 0x7fc340100aa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 -- 172.21.15.43:0/395719458 >> 172.21.15.43:0/395719458 conn(0x7fc340077390 msgr2=0x7fc3400fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 -- 172.21.15.43:0/395719458 shutdown_connections 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.300+0000 7fc344a4e640 1 -- 172.21.15.43:0/395719458 wait complete. 2024-04-25T20:53:21.304 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 Processor -- start 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 -- start start 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3401006c0 0x7fc34019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340198660 0x7fc340198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc340112300 con 0x7fc340107280 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc340112180 con 0x7fc3401006c0 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc344a4e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc340112480 con 0x7fc340198660 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc337fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc337fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33496/0 (socket says 172.21.15.43:33496) 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc33ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340198660 0x7fc340198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc337fff640 1 -- 172.21.15.43:0/1729430003 learned_addr learned my addr 172.21.15.43:0/1729430003 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.301+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3401006c0 0x7fc34019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 -- 172.21.15.43:0/1729430003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340198660 msgr2=0x7fc340198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340198660 0x7fc340198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 -- 172.21.15.43:0/1729430003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3401006c0 msgr2=0x7fc34019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3401006c0 0x7fc34019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 -- 172.21.15.43:0/1729430003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340199260 con 0x7fc340107280 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc337fff640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c970 tx=0x7fc32800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc3377fe640 1 -- 172.21.15.43:0/1729430003 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328007bb0 con 0x7fc340107280 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401a5340 con 0x7fc340107280 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc3377fe640 1 -- 172.21.15.43:0/1729430003 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc328007d50 con 0x7fc340107280 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc3377fe640 1 -- 172.21.15.43:0/1729430003 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32800f450 con 0x7fc340107280 2024-04-25T20:53:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.302+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401a5750 con 0x7fc340107280 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.304+0000 7fc3377fe640 1 -- 172.21.15.43:0/1729430003 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fc328004f60 con 0x7fc340107280 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.304+0000 7fc3473fd740 1 Processor -- start 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 -- start start 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d28132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d2815bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7d276d970 con 0x55e7d2808f40 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e7d270a4a0 con 0x55e7d2813800 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3473fd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e7d2769930 con 0x55e7d2808620 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d28132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3377fe640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 0x7fc32c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.43:51482/0 (socket says 172.21.15.43:51482) 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc337fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d2815bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33ed9d640 1 -- 172.21.15.43:0/469605549 learned_addr learned my addr 172.21.15.43:0/469605549 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 0x7fc32c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc3377fe640 1 -- 172.21.15.43:0/1729430003 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fc3280d0490 con 0x7fc340107280 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33e59c640 1 -- 172.21.15.43:0/469605549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 msgr2=0x55e7d2808a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33e59c640 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33e59c640 1 -- 172.21.15.43:0/469605549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 msgr2=0x55e7d2815bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.305+0000 7fc33e59c640 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d2815bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc33e59c640 1 -- 172.21.15.43:0/469605549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d2480210 con 0x55e7d2808f40 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc337fff640 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d2815bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:53:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc33e59c640 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d28132c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc330005940 tx=0x7fc330031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50d06347ff78a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 0x7fc32c0a6280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3380049d0 tx=0x7fc338004ab0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc334ff9640 1 -- 172.21.15.43:0/469605549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330040070 con 0x55e7d2808f40 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc334ff9640 1 -- 172.21.15.43:0/469605549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc330031710 con 0x55e7d2808f40 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.306+0000 7fc334ff9640 1 -- 172.21.15.43:0/469605549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330035040 con 0x55e7d2808f40 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- 172.21.15.43:0/469605549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 msgr2=0x55e7d28132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d28132c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc330005940 tx=0x7fc330031bc0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- 172.21.15.43:0/469605549 shutdown_connections 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d2815bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d28132c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- 172.21.15.43:0/469605549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d2808a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- 172.21.15.43:0/469605549 >> 172.21.15.43:0/469605549 conn(0x55e7d2804b30 msgr2=0x55e7d2804f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- 172.21.15.43:0/469605549 shutdown_connections 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- 172.21.15.43:0/469605549 wait complete. 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- start start 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 Processor -- start 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808f40 0x55e7d2810440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d28109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e7d28163d0 con 0x55e7d2808620 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e7d27080b0 con 0x55e7d2813800 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.307+0000 7fc3473fd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e7d2816550 con 0x55e7d2808f40 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc3473fd740 10 client.0 _ll_register_callbacks cb 0x55e7d26f5d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33516/0 (socket says 172.21.15.43:33516) 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 -- 172.21.15.43:0/3340225590 learned_addr learned my addr 172.21.15.43:0/3340225590 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:21.316 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d28109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc337fff640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808f40 0x55e7d2810440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 -- 172.21.15.43:0/3340225590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808f40 msgr2=0x55e7d2810440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808f40 0x55e7d2810440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 -- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 msgr2=0x55e7d28109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d28109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 -- 172.21.15.43:0/3340225590 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d254c620 con 0x55e7d2808620 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc33e59c640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc3300314b0 tx=0x7fc33002abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4a75ac5bbdaa16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc325ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330040030 con 0x55e7d2808620 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fc330004030 con 0x55e7d2808620 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc330031710 con 0x55e7d2808620 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc330056050 con 0x55e7d2808620 2024-04-25T20:53:21.317 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc3473fd740 10 client.15756 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.308+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e7d2822300 con 0x55e7d2808620 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc330031710 con 0x55e7d2808620 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fc330003660 con 0x55e7d2808620 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 10 client.15756 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 20 client.15756 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d2823650 0x55e7d2825a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 4 client.15756 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7d277b390 con 0x55e7d2823650 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc337fff640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d2823650 0x55e7d2825a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc337fff640 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d2823650 0x55e7d2825a40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d03fe7dae63d2e7 server_cookie=743a136850b9d52c in_seq=0 out_seq=0 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.309+0000 7fc325ffb640 10 client.15756 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.310+0000 7fc325ffb640 1 -- 172.21.15.43:0/3340225590 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e7d277b390 con 0x55e7d2823650 2024-04-25T20:53:21.318 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.310+0000 7fc325ffb640 10 client.15756 handle_command_reply: tid=0 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.310+0000 7fc3473fd740 1 client.15756 shutdown 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 msgr2=0x55e7d2813150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc3300314b0 tx=0x7fc33002abc0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 shutdown_connections 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d2823650 0x55e7d2825a40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d28109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808f40 0x55e7d2810440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 --2- 172.21.15.43:0/3340225590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d2813150 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc325ffb640 0 client.15756 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 >> 172.21.15.43:0/3340225590 conn(0x55e7d2804b30 msgr2=0x55e7d280a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 shutdown_connections 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 1 -- 172.21.15.43:0/3340225590 wait complete. 2024-04-25T20:53:21.319 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.311+0000 7fc3473fd740 20 client.15756 trim_cache size 0 max 16384 2024-04-25T20:53:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 Processor -- start 2024-04-25T20:53:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 -- start start 2024-04-25T20:53:21.331 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d281f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d282b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401adbb0 con 0x55e7d2808f40 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401af9f0 con 0x55e7d2813800 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc3473fd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401ae340 con 0x55e7d2808620 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33528/0 (socket says 172.21.15.43:33528) 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 -- 172.21.15.43:0/1197373416 learned_addr learned my addr 172.21.15.43:0/1197373416 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc33e59c640 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d281f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d282b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 -- 172.21.15.43:0/1197373416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 msgr2=0x55e7d281f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.332 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d281f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 -- 172.21.15.43:0/1197373416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 msgr2=0x55e7d282b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d282b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 -- 172.21.15.43:0/1197373416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7d2816010 con 0x55e7d2808f40 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc337fff640 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc328098ec0 tx=0x7fc3280988c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23ad2e71ef0f660 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.326+0000 7fc327fff640 1 -- 172.21.15.43:0/1197373416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32801d040 con 0x55e7d2808f40 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc327fff640 1 -- 172.21.15.43:0/1197373416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3280a50b0 con 0x55e7d2808f40 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc327fff640 1 -- 172.21.15.43:0/1197373416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280cde70 con 0x55e7d2808f40 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- 172.21.15.43:0/1197373416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 msgr2=0x55e7d2803b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc328098ec0 tx=0x7fc3280988c0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- 172.21.15.43:0/1197373416 shutdown_connections 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2813800 0x55e7d282b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808f40 0x55e7d2803b30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 --2- 172.21.15.43:0/1197373416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2808620 0x55e7d281f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- 172.21.15.43:0/1197373416 >> 172.21.15.43:0/1197373416 conn(0x55e7d2804b30 msgr2=0x55e7d2803420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- 172.21.15.43:0/1197373416 shutdown_connections 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- 172.21.15.43:0/1197373416 wait complete. 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 -- start start 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.327+0000 7fc3473fd740 1 Processor -- start 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2808f40 0x55e7d2818e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2813800 0x55e7d2819390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401af260 con 0x55e7d2808620 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401aead0 con 0x55e7d2808f40 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401abb90 con 0x55e7d2813800 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 10 client.0 _ll_register_callbacks cb 0x7fc330005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33534/0 (socket says 172.21.15.43:33534) 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 -- 172.21.15.43:0/586771809 learned_addr learned my addr 172.21.15.43:0/586771809 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc337fff640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2808f40 0x55e7d2818e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33ed9d640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2813800 0x55e7d2819390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 -- 172.21.15.43:0/586771809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2813800 msgr2=0x55e7d2819390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2813800 0x55e7d2819390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 -- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2808f40 msgr2=0x55e7d2818e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2808f40 0x55e7d2818e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 -- 172.21.15.43:0/586771809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7d2819b90 con 0x55e7d2808620 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc33e59c640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc330003a00 tx=0x7fc330031ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee222dc6537ba3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc325ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33005e030 con 0x55e7d2808620 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fc330005230 con 0x55e7d2808620 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.328+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3280a50b0 con 0x55e7d2808620 2024-04-25T20:53:21.335 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc330068050 con 0x55e7d2808620 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 10 client.15762 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e7d28898f0 con 0x55e7d2808620 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3280a50b0 con 0x55e7d2808620 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fc330003c80 con 0x55e7d2808620 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 10 client.15762 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 20 client.15762 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d288a090 0x55e7d288c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 4 client.15762 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7d2775200 con 0x55e7d288a090 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.329+0000 7fc337fff640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d288a090 0x55e7d288c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.330+0000 7fc325ffb640 10 client.15762 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:21.336 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.330+0000 7fc337fff640 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d288a090 0x55e7d288c4b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a2704b006adc75a server_cookie=6395b03be2751217 in_seq=0 out_seq=0 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.433+0000 7fc325ffb640 1 -- 172.21.15.43:0/586771809 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7d2775200 con 0x55e7d288a090 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc325ffb640 10 client.15762 handle_command_reply: tid=0 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 client.15762 shutdown 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 msgr2=0x55e7d281bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc330003a00 tx=0x7fc330031ad0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 shutdown_connections 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55e7d288a090 0x55e7d288c4b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e7d2813800 0x55e7d2819390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc325ffb640 0 client.15762 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7d2808f40 0x55e7d2818e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 --2- 172.21.15.43:0/586771809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e7d2808620 0x55e7d281bac0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 >> 172.21.15.43:0/586771809 conn(0x55e7d2804b30 msgr2=0x55e7d2803cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 shutdown_connections 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 1 -- 172.21.15.43:0/586771809 wait complete. 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.434+0000 7fc3473fd740 20 client.15762 trim_cache size 0 max 16384 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:53:21.437 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:53:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 msgr2=0x7fc32c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 0x7fc32c0a6280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3380049d0 tx=0x7fc338004ab0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 msgr2=0x7fc34019eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c970 tx=0x7fc32800ce30 comp rx=0 tx=0).stop 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 shutdown_connections 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc32c0a3dc0 0x7fc32c0a6280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc340198660 0x7fc340198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc340107280 0x7fc34019eae0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 --2- 172.21.15.43:0/1729430003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3401006c0 0x7fc34019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 >> 172.21.15.43:0/1729430003 conn(0x7fc340077390 msgr2=0x7fc3401053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 shutdown_connections 2024-04-25T20:53:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:21.435+0000 7fc344a4e640 1 -- 172.21.15.43:0/1729430003 wait complete. 2024-04-25T20:53:22.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:21 smithi043 ceph-mon[29167]: pgmap v104: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 1.08k op/s 2024-04-25T20:53:22.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:21 smithi195 ceph-mon[33250]: pgmap v104: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 1.08k op/s 2024-04-25T20:53:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:21 smithi112 ceph-mon[32322]: pgmap v104: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 1.08k op/s 2024-04-25T20:53:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:23 smithi043 ceph-mon[29167]: pgmap v105: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-04-25T20:53:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:23 smithi195 ceph-mon[33250]: pgmap v105: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-04-25T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:23 smithi112 ceph-mon[32322]: pgmap v105: 97 pgs: 97 active+clean; 211 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-04-25T20:53:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:25 smithi043 ceph-mon[29167]: pgmap v106: 97 pgs: 97 active+clean; 199 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 625 op/s 2024-04-25T20:53:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:25 smithi195 ceph-mon[33250]: pgmap v106: 97 pgs: 97 active+clean; 199 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 625 op/s 2024-04-25T20:53:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:25 smithi112 ceph-mon[32322]: pgmap v106: 97 pgs: 97 active+clean; 199 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 625 op/s 2024-04-25T20:53:28.025 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-04-25T20:53:28.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T20:53:28.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:27 smithi043 ceph-mon[29167]: pgmap v107: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-04-25T20:53:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:27 smithi195 ceph-mon[33250]: pgmap v107: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-04-25T20:53:28.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:27 smithi112 ceph-mon[32322]: pgmap v107: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-04-25T20:53:28.377 DEBUG:teuthology.parallel:result is None 2024-04-25T20:53:28.378 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T20:53:28.413 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T20:53:28.413 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T20:53:28.424 INFO:tasks.quiescer:joining Quiescers 2024-04-25T20:53:28.424 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-25T20:53:28.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T20:53:28.699 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:53:30.270 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:29 smithi043 ceph-mon[29167]: pgmap v108: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 344 op/s 2024-04-25T20:53:30.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:29 smithi195 ceph-mon[33250]: pgmap v108: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 344 op/s 2024-04-25T20:53:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:29 smithi112 ceph-mon[32322]: pgmap v108: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 344 op/s 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 -- 172.21.15.43:0/4184014006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 msgr2=0x7f99ec106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 --2- 172.21.15.43:0/4184014006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec106d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009990 tx=0x7f99dc009ca0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 -- 172.21.15.43:0/4184014006 shutdown_connections 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 --2- 172.21.15.43:0/4184014006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec1026e0 0x7f99ec10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 --2- 172.21.15.43:0/4184014006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec106d70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 --2- 172.21.15.43:0/4184014006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec101d20 0x7f99ec1021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 -- 172.21.15.43:0/4184014006 >> 172.21.15.43:0/4184014006 conn(0x7f99ec0788f0 msgr2=0x7f99ec078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:30.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 -- 172.21.15.43:0/4184014006 shutdown_connections 2024-04-25T20:53:30.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.688+0000 7f99f2886700 1 -- 172.21.15.43:0/4184014006 wait complete. 2024-04-25T20:53:30.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 Processor -- start 2024-04-25T20:53:30.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 -- start start 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 0x7f99ec1035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec1026e0 0x7f99ec103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec111c90 con 0x7f99ec106990 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec111b10 con 0x7f99ec101d20 2024-04-25T20:53:30.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f2886700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec111e10 con 0x7f99ec1026e0 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f0e23700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f0e23700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52382/0 (socket says 172.21.15.43:52382) 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99f0e23700 1 -- 172.21.15.43:0/1585018721 learned_addr learned my addr 172.21.15.43:0/1585018721 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99ebfff700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 0x7f99ec1035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.689+0000 7f99eb7fe700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec1026e0 0x7f99ec103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 -- 172.21.15.43:0/1585018721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec1026e0 msgr2=0x7f99ec103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec1026e0 0x7f99ec103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 -- 172.21.15.43:0/1585018721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 msgr2=0x7f99ec1035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 0x7f99ec1035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 -- 172.21.15.43:0/1585018721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec1a76c0 con 0x7f99ec106990 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99ebfff700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 0x7f99ec1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f0e23700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f99e4007ee0 tx=0x7f99e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4004bb0 con 0x7f99ec106990 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec1a79b0 con 0x7f99ec106990 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f99e4004d50 con 0x7f99ec106990 2024-04-25T20:53:30.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e40059e0 con 0x7f99ec106990 2024-04-25T20:53:30.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.690+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec1a7ef0 con 0x7f99ec106990 2024-04-25T20:53:30.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.691+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec103080 con 0x7f99ec106990 2024-04-25T20:53:30.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.692+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f99e401a020 con 0x7f99ec106990 2024-04-25T20:53:30.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.693+0000 7f99e97fa700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 0x7f99d40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:30.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.693+0000 7f99ebfff700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 0x7f99d40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:30.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.693+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f99e40cfea0 con 0x7f99ec106990 2024-04-25T20:53:30.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.694+0000 7f99ebfff700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 0x7f99d40a6270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0098e0 tx=0x7f99dc005960 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:30.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.698+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f99e4010070 con 0x7f99ec106990 2024-04-25T20:53:30.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.952+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99ec02df80 con 0x7f99ec106990 2024-04-25T20:53:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.952+0000 7f99e97fa700 1 -- 172.21.15.43:0/1585018721 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11971 (secure 0 0 0) 0x7f99e409c570 con 0x7f99ec106990 2024-04-25T20:53:30.953 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T20:53:30.953 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:53:02.732975+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24449,24470,24448,24430,24424]},"id":1}]} 2024-04-25T20:53:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.954+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 msgr2=0x7f99d40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.954+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 0x7f99d40a6270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0098e0 tx=0x7f99dc005960 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.954+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 msgr2=0x7f99ec104060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.954+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f99e4007ee0 tx=0x7f99e400d3b0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 shutdown_connections 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f99d40a3db0 0x7f99d40a6270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99ec106990 0x7f99ec104060 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99ec101d20 0x7f99ec1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 --2- 172.21.15.43:0/1585018721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99ec1026e0 0x7f99ec103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 >> 172.21.15.43:0/1585018721 conn(0x7f99ec0788f0 msgr2=0x7f99ec06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 shutdown_connections 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:30.955+0000 7f99f2886700 1 -- 172.21.15.43:0/1585018721 wait complete. 2024-04-25T20:53:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 42 2024-04-25T20:53:31.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24470 quiesce db --cancel --all' 2024-04-25T20:53:31.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24470 quiesce db --cancel --all 2024-04-25T20:53:32.156 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T20:53:32.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:31 smithi043 ceph-mon[29167]: pgmap v109: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 501 op/s 2024-04-25T20:53:32.192 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:31 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1585018721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:53:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:31 smithi195 ceph-mon[33250]: pgmap v109: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 501 op/s 2024-04-25T20:53:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:31 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1585018721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:53:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:31 smithi112 ceph-mon[32322]: pgmap v109: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 501 op/s 2024-04-25T20:53:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:31 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1585018721' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T20:53:34.193 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:33 smithi043 ceph-mon[29167]: pgmap v110: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 -- 172.21.15.43:0/1441928256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 msgr2=0x7f7d88106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 --2- 172.21.15.43:0/1441928256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d88106d70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009990 tx=0x7f7d84009ca0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 -- 172.21.15.43:0/1441928256 shutdown_connections 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 --2- 172.21.15.43:0/1441928256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 0x7f7d8810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 --2- 172.21.15.43:0/1441928256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d88106d70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 --2- 172.21.15.43:0/1441928256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 -- 172.21.15.43:0/1441928256 >> 172.21.15.43:0/1441928256 conn(0x7f7d880788f0 msgr2=0x7f7d88078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 -- 172.21.15.43:0/1441928256 shutdown_connections 2024-04-25T20:53:34.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.202+0000 7f7d90257700 1 -- 172.21.15.43:0/1441928256 wait complete. 2024-04-25T20:53:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 Processor -- start 2024-04-25T20:53:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 -- start start 2024-04-25T20:53:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 0x7f7d88199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111cf0 con 0x7f7d88106990 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111b70 con 0x7f7d881026e0 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d90257700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111e70 con 0x7f7d88101d20 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52398/0 (socket says 172.21.15.43:52398) 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.203+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226781199 learned_addr learned my addr 172.21.15.43:0/2226781199 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 0x7f7d88199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226781199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 msgr2=0x7f7d881992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226781199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 msgr2=0x7f7d88199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 0x7f7d88199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226781199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8819e2e0 con 0x7f7d88106990 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b970 tx=0x7f7d8000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d7effd700 1 -- 172.21.15.43:0/2226781199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80019070 con 0x7f7d88106990 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d7effd700 1 -- 172.21.15.43:0/2226781199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d8000ce00 con 0x7f7d88106990 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8819e5d0 con 0x7f7d88106990 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d7effd700 1 -- 172.21.15.43:0/2226781199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80007370 con 0x7f7d88106990 2024-04-25T20:53:34.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.204+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a5e50 con 0x7f7d88106990 2024-04-25T20:53:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.206+0000 7f7d7effd700 1 -- 172.21.15.43:0/2226781199 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7d8001c070 con 0x7f7d88106990 2024-04-25T20:53:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.207+0000 7f7d7effd700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.207+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.207+0000 7f7d7effd700 1 -- 172.21.15.43:0/2226781199 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f7d800cfa50 con 0x7f7d88106990 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 0x7f7d740a6270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d84006010 tx=0x7f7d8400b540 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 Processor -- start 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 -- start start 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6029d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6034c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f2d5f7cda0 con 0x55f2d6035150 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d5f239d0 con 0x55f2d6029960 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.208+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f2d5f78d60 con 0x55f2d602a280 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52402/0 (socket says 172.21.15.43:52402) 2024-04-25T20:53:34.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/3661489086 learned_addr learned my addr 172.21.15.43:0/3661489086 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6029d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/3661489086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 msgr2=0x55f2d6034c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6034c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/3661489086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 msgr2=0x55f2d6029d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6029d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/3661489086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d5eca940 con 0x55f2d6035150 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6029d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6034c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7d80098500 tx=0x7f7d8009c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c030b7ae7ca383 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d73fff700 1 -- 172.21.15.43:0/3661489086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8009ce60 con 0x55f2d6035150 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d73fff700 1 -- 172.21.15.43:0/3661489086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d800a47a0 con 0x55f2d6035150 2024-04-25T20:53:34.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.209+0000 7f7d73fff700 1 -- 172.21.15.43:0/3661489086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8009bff0 con 0x55f2d6035150 2024-04-25T20:53:34.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3661489086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 msgr2=0x55f2d6037540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7d80098500 tx=0x7f7d8009c2b0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3661489086 shutdown_connections 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6037540 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6029d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3661489086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6034c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3661489086 >> 172.21.15.43:0/3661489086 conn(0x55f2d5f57700 msgr2=0x55f2d6025e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3661489086 shutdown_connections 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.210+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3661489086 wait complete. 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 -- start start 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 Processor -- start 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6034940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6031c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6037b40 con 0x55f2d6035150 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f2d5f1bc40 con 0x55f2d6029960 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55f2d6037cc0 con 0x55f2d602a280 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d9aae0b80 10 client.0 _ll_register_callbacks cb 0x55f2d5f159c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52416/0 (socket says 172.21.15.43:52416) 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.211+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/1212741523 learned_addr learned my addr 172.21.15.43:0/1212741523 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6031c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6034940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/1212741523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 msgr2=0x55f2d6031c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6031c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 msgr2=0x55f2d6034940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6034940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/1212741523 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d5f342e0 con 0x55f2d6035150 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7d800a4270 tx=0x7f7d80099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b66ce9e278a57e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8009bd90 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f7d8009bf30 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d800a47a0 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7d800a4310 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d9aae0b80 10 client.15780 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.212+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f2d60423a0 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d800a47a0 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f7d80097880 con 0x55f2d6035150 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 10 client.15780 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 10 client.15780 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 20 client.15780 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d6044870 0x55f2d6046c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 4 client.15780 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2d5f8a590 con 0x55f2d6044870 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.213+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d6044870 0x55f2d6046c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d6044870 0x55f2d6046c60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23eeae9f8690dca server_cookie=c3dd3732d134257e in_seq=0 out_seq=0 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d717fa700 10 client.15780 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d717fa700 1 -- 172.21.15.43:0/1212741523 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f2d5f8a590 con 0x55f2d6044870 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d717fa700 10 client.15780 handle_command_reply: tid=0 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d9aae0b80 1 client.15780 shutdown 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 msgr2=0x55f2d6032180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.214+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7d800a4270 tx=0x7f7d80099ea0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 shutdown_connections 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d6044870 0x55f2d6046c60 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d6032180 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d6034940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d717fa700 0 client.15780 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/1212741523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d6031c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 >> 172.21.15.43:0/1212741523 conn(0x55f2d5f57700 msgr2=0x55f2d6025a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 shutdown_connections 2024-04-25T20:53:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/1212741523 wait complete. 2024-04-25T20:53:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.215+0000 7f7d9aae0b80 20 client.15780 trim_cache size 0 max 16384 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 Processor -- start 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 -- start start 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d602a280 0x55f2d6049c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d6035150 0x55f2d604a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ad4b0 con 0x55f2d6029960 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881af2f0 con 0x55f2d602a280 2024-04-25T20:53:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881adc40 con 0x55f2d6035150 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52426/0 (socket says 172.21.15.43:52426) 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 -- 172.21.15.43:0/3537411922 learned_addr learned my addr 172.21.15.43:0/3537411922 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d602a280 0x55f2d6049c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 -- 172.21.15.43:0/3537411922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d6035150 msgr2=0x55f2d604a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d6035150 0x55f2d604a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 -- 172.21.15.43:0/3537411922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d602a280 msgr2=0x55f2d6049c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d602a280 0x55f2d6049c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 -- 172.21.15.43:0/3537411922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2d6032640 con 0x55f2d6029960 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.235+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7d840036d0 tx=0x7f7d8401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8da1665e88365e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d737fe700 1 -- 172.21.15.43:0/3537411922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84039070 con 0x55f2d6029960 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d737fe700 1 -- 172.21.15.43:0/3537411922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d84005580 con 0x55f2d6029960 2024-04-25T20:53:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d737fe700 1 -- 172.21.15.43:0/3537411922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d840346c0 con 0x55f2d6029960 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3537411922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 msgr2=0x55f2d6034480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7d840036d0 tx=0x7f7d8401f000 comp rx=0 tx=0).stop 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3537411922 shutdown_connections 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d6035150 0x55f2d604a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6029960 0x55f2d6034480 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/3537411922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d602a280 0x55f2d6049c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3537411922 >> 172.21.15.43:0/3537411922 conn(0x55f2d5f57700 msgr2=0x55f2d603ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3537411922 shutdown_connections 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.236+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/3537411922 wait complete. 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 -- start start 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 Processor -- start 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d60a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d60a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881aeb60 con 0x55f2d6035150 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ae3d0 con 0x55f2d6029960 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881ab450 con 0x55f2d602a280 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d9aae0b80 10 client.0 _ll_register_callbacks cb 0x55f2d5f159c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d8e7f4700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52428/0 (socket says 172.21.15.43:52428) 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226812684 learned_addr learned my addr 172.21.15.43:0/2226812684 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d8d7f2700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d60a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.237+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d60a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226812684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 msgr2=0x55f2d60a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d60a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 msgr2=0x55f2d60a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d60a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 -- 172.21.15.43:0/2226812684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2d609f0e0 con 0x55f2d6035150 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d8e7f4700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7d800cd340 tx=0x7f7d800cd390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6b4178a5824524 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8009ce60 con 0x55f2d6035150 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7f7d80097880 con 0x55f2d6035150 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d84005580 con 0x55f2d6035150 2024-04-25T20:53:34.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7d80097dd0 con 0x55f2d6035150 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d9aae0b80 10 client.15786 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f2d609f0e0 con 0x55f2d6035150 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d84005580 con 0x55f2d6035150 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.238+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7f7d800146f0 con 0x55f2d6035150 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 10 client.15786 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 10 client.15786 resolve_mds: validated gid 24470 aka daemon mds.b 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 20 client.15786 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d60abae0 0x55f2d60adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 4 client.15786 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f2d5f84630 con 0x55f2d60abae0 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d60abae0 0x55f2d60adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d717fa700 10 client.15786 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.239+0000 7f7d8dff3700 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d60abae0 0x55f2d60adf00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ec8684b5386cc1 server_cookie=e193bf9bcfc5aef8 in_seq=0 out_seq=0 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d717fa700 1 -- 172.21.15.43:0/2226812684 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55f2d5f84630 con 0x55f2d60abae0 2024-04-25T20:53:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d717fa700 10 client.15786 handle_command_reply: tid=0 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 client.15786 shutdown 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 msgr2=0x55f2d609e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7d800cd340 tx=0x7f7d800cd390 comp rx=0 tx=0).stop 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 shutdown_connections 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55f2d60abae0 0x55f2d60adf00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2d6035150 0x55f2d609e9e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f2d6029960 0x55f2d60a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 --2- 172.21.15.43:0/2226812684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f2d602a280 0x55f2d60a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d717fa700 0 client.15786 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 >> 172.21.15.43:0/2226812684 conn(0x55f2d5f57700 msgr2=0x55f2d60407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 shutdown_connections 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 1 -- 172.21.15.43:0/2226812684 wait complete. 2024-04-25T20:53:34.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d9aae0b80 20 client.15786 trim_cache size 0 max 16384 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 42, 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: "leader": 24470, 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: "set_version": 8, 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout: "sets": {} 2024-04-25T20:53:34.246 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 msgr2=0x7f7d740a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 0x7f7d740a6270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d84006010 tx=0x7f7d8400b540 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 msgr2=0x7f7d8819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.240+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b970 tx=0x7f7d8000bc80 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 shutdown_connections 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d88101d20 0x7f7d881992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d88106990 0x7f7d8819dba0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 --2- 172.21.15.43:0/2226781199 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d881026e0 0x7f7d88199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 >> 172.21.15.43:0/2226781199 conn(0x7f7d880788f0 msgr2=0x7f7d881010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 shutdown_connections 2024-04-25T20:53:34.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T20:53:34.241+0000 7f7d90257700 1 -- 172.21.15.43:0/2226781199 wait complete. 2024-04-25T20:53:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:33 smithi195 ceph-mon[33250]: pgmap v110: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-04-25T20:53:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:33 smithi112 ceph-mon[32322]: pgmap v110: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 -- 172.21.15.43:0/3153443539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd364103200 msgr2=0x7fd3641035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 --2- 172.21.15.43:0/3153443539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd364103200 0x7fd3641035e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009900 tx=0x7fd35c02a480 comp rx=0 tx=0).stop 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 -- 172.21.15.43:0/3153443539 shutdown_connections 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 --2- 172.21.15.43:0/3153443539 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd36410c5d0 0x7fd36410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 --2- 172.21.15.43:0/3153443539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 0x7fd36410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.529+0000 7fd368f3d640 1 --2- 172.21.15.43:0/3153443539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd364103200 0x7fd3641035e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.533 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.530+0000 7fd368f3d640 1 -- 172.21.15.43:0/3153443539 >> 172.21.15.43:0/3153443539 conn(0x7fd3640771d0 msgr2=0x7fd3640775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.530+0000 7fd368f3d640 1 -- 172.21.15.43:0/3153443539 shutdown_connections 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.530+0000 7fd368f3d640 1 -- 172.21.15.43:0/3153443539 wait complete. 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.530+0000 7fd368f3d640 1 Processor -- start 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.530+0000 7fd368f3d640 1 -- start start 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd364103200 0x7fd3641a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 0x7fd3641a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd364112330 con 0x7fd36410c5d0 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641121b0 con 0x7fd364103200 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641124b0 con 0x7fd364103b20 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52446/0 (socket says 172.21.15.43:52446) 2024-04-25T20:53:34.534 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 -- 172.21.15.43:0/1887452257 learned_addr learned my addr 172.21.15.43:0/1887452257 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd36259c640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd364103200 0x7fd3641a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 0x7fd3641a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 -- 172.21.15.43:0/1887452257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 msgr2=0x7fd3641a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 0x7fd3641a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 -- 172.21.15.43:0/1887452257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd364103200 msgr2=0x7fd3641a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd364103200 0x7fd3641a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 -- 172.21.15.43:0/1887452257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36419af80 con 0x7fd36410c5d0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd362d9d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd35400e970 tx=0x7fd35400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd3537fe640 1 -- 172.21.15.43:0/1887452257 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35400ccc0 con 0x7fd36410c5d0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36419b270 con 0x7fd36410c5d0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd3537fe640 1 -- 172.21.15.43:0/1887452257 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3540054f0 con 0x7fd36410c5d0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.531+0000 7fd3537fe640 1 -- 172.21.15.43:0/1887452257 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354010690 con 0x7fd36410c5d0 2024-04-25T20:53:34.535 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.532+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3641a7490 con 0x7fd36410c5d0 2024-04-25T20:53:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.534+0000 7fd3537fe640 1 -- 172.21.15.43:0/1887452257 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd354004e20 con 0x7fd36410c5d0 2024-04-25T20:53:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.534+0000 7fd36bc58740 1 Processor -- start 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.534+0000 7fd36bc58740 1 -- start start 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf655970 con 0x55a8cf6f0f40 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf5f24a0 con 0x55a8cf6fb800 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36bc58740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf651930 con 0x55a8cf6f0620 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd3537fe640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 0x7fd34c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52448/0 (socket says 172.21.15.43:52448) 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 -- 172.21.15.43:0/1981630743 learned_addr learned my addr 172.21.15.43:0/1981630743 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd362d9d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 0x7fd34c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 -- 172.21.15.43:0/1981630743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 msgr2=0x55a8cf6f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 -- 172.21.15.43:0/1981630743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6fb800 msgr2=0x55a8cf6fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 -- 172.21.15.43:0/1981630743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8cf368210 con 0x55a8cf6f0f40 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd3537fe640 1 -- 172.21.15.43:0/1887452257 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fd3540d0bd0 con 0x7fd36410c5d0 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd36259c640 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009900 tx=0x7fd35c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8bcbc035afd7cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd362d9d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 0x7fd34c0a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd35409c840 tx=0x7fd354093040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.535+0000 7fd350ff9640 1 -- 172.21.15.43:0/1981630743 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c040070 con 0x55a8cf6f0f40 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd350ff9640 1 -- 172.21.15.43:0/1981630743 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd35c004020 con 0x55a8cf6f0f40 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd350ff9640 1 -- 172.21.15.43:0/1981630743 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c035040 con 0x55a8cf6f0f40 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 -- 172.21.15.43:0/1981630743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 msgr2=0x55a8cf6fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009900 tx=0x7fd35c005c00 comp rx=0 tx=0).stop 2024-04-25T20:53:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 -- 172.21.15.43:0/1981630743 shutdown_connections 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6fb2c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1981630743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 -- 172.21.15.43:0/1981630743 >> 172.21.15.43:0/1981630743 conn(0x55a8cf6ecb30 msgr2=0x55a8cf6ecf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 -- 172.21.15.43:0/1981630743 shutdown_connections 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.536+0000 7fd36bc58740 1 -- 172.21.15.43:0/1981630743 wait complete. 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 -- start start 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 Processor -- start 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6f8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf6fe3d0 con 0x55a8cf6fb800 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf5f00b0 con 0x55a8cf6f0f40 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55a8cf6fe550 con 0x55a8cf6f0620 2024-04-25T20:53:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36bc58740 10 client.0 _ll_register_callbacks cb 0x55a8cf5ddd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52452/0 (socket says 172.21.15.43:52452) 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 -- 172.21.15.43:0/1603871420 learned_addr learned my addr 172.21.15.43:0/1603871420 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd36259c640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 -- 172.21.15.43:0/1603871420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 msgr2=0x55a8cf6fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.537+0000 7fd361d9b640 1 -- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 msgr2=0x55a8cf6f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd361d9b640 1 -- 172.21.15.43:0/1603871420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8cf434620 con 0x55a8cf6fb800 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36259c640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:53:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd358005fd0 tx=0x7fd358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae2e3aee018bad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35800fe30 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fd358004b20 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd35c004020 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd358025050 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 10 client.15798 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a8cf70a2d0 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd35c004020 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fd35800c030 con 0x55a8cf6fb800 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 10 client.15798 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 20 client.15798 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf70b810 0x55a8cf70dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 4 client.15798 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.538+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8cf663390 con 0x55a8cf70b810 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.539+0000 7fd36259c640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf70b810 0x55a8cf70dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.539+0000 7fd36259c640 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf70b810 0x55a8cf70dcb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e44fdddee01471 server_cookie=550282835b84624f in_seq=0 out_seq=0 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.539+0000 7fd349ffb640 10 client.15798 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd349ffb640 1 -- 172.21.15.43:0/1603871420 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8cf663390 con 0x55a8cf70b810 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd349ffb640 10 client.15798 handle_command_reply: tid=0 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 client.15798 shutdown 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 msgr2=0x55a8cf6f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd358005fd0 tx=0x7fd358004a40 comp rx=0 tx=0).stop 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 shutdown_connections 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf70b810 0x55a8cf70dcb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6f89c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd349ffb640 0 client.15798 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1603871420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0620 0x55a8cf6fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 >> 172.21.15.43:0/1603871420 conn(0x55a8cf6ecb30 msgr2=0x55a8cf6f2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 shutdown_connections 2024-04-25T20:53:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 1 -- 172.21.15.43:0/1603871420 wait complete. 2024-04-25T20:53:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.540+0000 7fd36bc58740 20 client.15798 trim_cache size 0 max 16384 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 Processor -- start 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 -- start start 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf707290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641afe00 con 0x55a8cf6fb800 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641b1c40 con 0x55a8cf6f0620 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.555+0000 7fd36bc58740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641b0590 con 0x55a8cf6f0f40 2024-04-25T20:53:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52464/0 (socket says 172.21.15.43:52464) 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 -- 172.21.15.43:0/1142887582 learned_addr learned my addr 172.21.15.43:0/1142887582 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf707290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd36259c640 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 -- 172.21.15.43:0/1142887582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 msgr2=0x55a8cf6ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6ebb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 -- 172.21.15.43:0/1142887582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 msgr2=0x55a8cf707290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf707290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 -- 172.21.15.43:0/1142887582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8cf6f0d70 con 0x55a8cf6fb800 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd361d9b640 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd358005b40 tx=0x7fd358009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4525667f2043eb3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd34bfff640 1 -- 172.21.15.43:0/1142887582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35800fbc0 con 0x55a8cf6fb800 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd34bfff640 1 -- 172.21.15.43:0/1142887582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd35801ee70 con 0x55a8cf6fb800 2024-04-25T20:53:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.556+0000 7fd34bfff640 1 -- 172.21.15.43:0/1142887582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580115f0 con 0x55a8cf6fb800 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- 172.21.15.43:0/1142887582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 msgr2=0x55a8cf6faca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd358005b40 tx=0x7fd358009fd0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- 172.21.15.43:0/1142887582 shutdown_connections 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6faca0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf6ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- 172.21.15.43:0/1142887582 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf707290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- 172.21.15.43:0/1142887582 >> 172.21.15.43:0/1142887582 conn(0x55a8cf6ecb30 msgr2=0x55a8cf6eb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- 172.21.15.43:0/1142887582 shutdown_connections 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- 172.21.15.43:0/1142887582 wait complete. 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- start start 2024-04-25T20:53:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 Processor -- start 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf76a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf76a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641b14b0 con 0x55a8cf6fb800 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641b0d20 con 0x55a8cf6f0620 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.557+0000 7fd36bc58740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd3641adde0 con 0x55a8cf6f0f40 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36bc58740 10 client.0 _ll_register_callbacks cb 0x7fd3580129a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52476/0 (socket says 172.21.15.43:52476) 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 -- 172.21.15.43:0/158396753 learned_addr learned my addr 172.21.15.43:0/158396753 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36259c640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf76a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf76a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 -- 172.21.15.43:0/158396753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 msgr2=0x55a8cf76a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf76a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 -- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 msgr2=0x55a8cf76a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf76a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 -- 172.21.15.43:0/158396753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8cf6ff000 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36259c640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf76a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd361d9b640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd358012ab0 tx=0x7fd358012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0abd11f7db05404 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd349ffb640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358039060 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8469+0+0 (secure 0 0 0) 0x7fd35801e9a0 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd35801ee70 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd35801eba0 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36bc58740 10 client.15804 fetch_fsmap learned FSMap version 42 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.558+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a8cf771830 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd35801ee70 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 42) ==== 8434+0+0 (secure 0 0 0) 0x7fd35800c040 con 0x55a8cf6fb800 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 10 client.15804 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T20:53:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 20 client.15804 populate_metadata read hostname 'smithi043' 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf771f00 0x55a8cf774320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 4 client.15804 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 --> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8cf65d200 con 0x55a8cf771f00 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.559+0000 7fd36259c640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf771f00 0x55a8cf774320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.560+0000 7fd36259c640 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf771f00 0x55a8cf774320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e69b8596400645 server_cookie=5c7cb36d8bde4b9e in_seq=0 out_seq=0 2024-04-25T20:53:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.560+0000 7fd349ffb640 10 client.15804 ms_handle_connect on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd349ffb640 1 -- 172.21.15.43:0/158396753 <== mds.0 v2:172.21.15.112:6838/2400080298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8cf65d200 con 0x55a8cf771f00 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd349ffb640 10 client.15804 handle_command_reply: tid=0 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 client.15804 shutdown 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 msgr2=0x55a8cf6fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd358012ab0 tx=0x7fd358012cf0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 shutdown_connections 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:6838/2400080298,v1:172.21.15.112:6839/2400080298] conn(0x55a8cf771f00 0x55a8cf774320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8cf6fb800 0x55a8cf6fe940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a8cf6f0f40 0x55a8cf76a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 --2- 172.21.15.43:0/158396753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a8cf6f0620 0x55a8cf76a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd349ffb640 0 client.15804 ms_handle_reset on v2:172.21.15.112:6838/2400080298 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.579+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 >> 172.21.15.43:0/158396753 conn(0x55a8cf6ecb30 msgr2=0x55a8cf6f39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 shutdown_connections 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd36bc58740 1 -- 172.21.15.43:0/158396753 wait complete. 2024-04-25T20:53:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd36bc58740 20 client.15804 trim_cache size 0 max 16384 2024-04-25T20:53:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:{ 2024-04-25T20:53:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "message": "", 2024-04-25T20:53:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout: "return_code": 0 2024-04-25T20:53:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stdout:} 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 msgr2=0x7fd34c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 0x7fd34c0a6280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd35409c840 tx=0x7fd354093040 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 msgr2=0x7fd36419a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd35400e970 tx=0x7fd35400ee30 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 shutdown_connections 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fd34c0a3dc0 0x7fd34c0a6280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd36410c5d0 0x7fd36419a7b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd364103b20 0x7fd3641a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 --2- 172.21.15.43:0/1887452257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd364103200 0x7fd3641a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T20:53:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 >> 172.21.15.43:0/1887452257 conn(0x7fd3640771d0 msgr2=0x7fd364101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T20:53:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 shutdown_connections 2024-04-25T20:53:34.584 INFO:teuthology.task.background_exec.ubuntu@smithi043.front.sepia.ceph.com.smithi043.stderr:2024-04-25T20:53:34.580+0000 7fd368f3d640 1 -- 172.21.15.43:0/1887452257 wait complete. 2024-04-25T20:53:35.121 INFO:tasks.quiescer:done joining Quiescers 2024-04-25T20:53:35.121 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-25T20:53:35.133 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:53:35.143 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-25T20:53:35.156 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-25T20:53:35.157 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T20:53:35.157 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T20:53:35.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-25T20:53:35.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-25T20:53:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:35 smithi043 ceph-mon[29167]: pgmap v111: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 369 op/s 2024-04-25T20:53:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:35 smithi195 ceph-mon[33250]: pgmap v111: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 369 op/s 2024-04-25T20:53:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:35 smithi112 ceph-mon[32322]: pgmap v111: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 369 op/s 2024-04-25T20:53:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:37 smithi043 ceph-mon[29167]: pgmap v112: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 513 KiB/s wr, 209 op/s 2024-04-25T20:53:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:37 smithi195 ceph-mon[33250]: pgmap v112: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 513 KiB/s wr, 209 op/s 2024-04-25T20:53:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:37 smithi112 ceph-mon[32322]: pgmap v112: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 513 KiB/s wr, 209 op/s 2024-04-25T20:53:40.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:39 smithi043 ceph-mon[29167]: pgmap v113: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 164 op/s 2024-04-25T20:53:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:39 smithi195 ceph-mon[33250]: pgmap v113: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 164 op/s 2024-04-25T20:53:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:39 smithi112 ceph-mon[32322]: pgmap v113: 97 pgs: 97 active+clean; 191 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 164 op/s 2024-04-25T20:53:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:41 smithi043 ceph-mon[29167]: pgmap v114: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 514 KiB/s wr, 178 op/s 2024-04-25T20:53:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:41 smithi195 ceph-mon[33250]: pgmap v114: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 514 KiB/s wr, 178 op/s 2024-04-25T20:53:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:41 smithi112 ceph-mon[32322]: pgmap v114: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 514 KiB/s wr, 178 op/s 2024-04-25T20:53:44.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:43 smithi043 ceph-mon[29167]: pgmap v115: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-04-25T20:53:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:43 smithi195 ceph-mon[33250]: pgmap v115: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-04-25T20:53:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:43 smithi112 ceph-mon[32322]: pgmap v115: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 KiB/s wr, 21 op/s 2024-04-25T20:53:46.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:45 smithi043 ceph-mon[29167]: pgmap v116: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-25T20:53:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:45 smithi195 ceph-mon[33250]: pgmap v116: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-25T20:53:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:45 smithi112 ceph-mon[32322]: pgmap v116: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-04-25T20:53:48.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:47 smithi043 ceph-mon[29167]: pgmap v117: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:47 smithi195 ceph-mon[33250]: pgmap v117: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:48.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:47 smithi112 ceph-mon[32322]: pgmap v117: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:50.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:49 smithi043 ceph-mon[29167]: pgmap v118: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:49 smithi195 ceph-mon[33250]: pgmap v118: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:49 smithi112 ceph-mon[32322]: pgmap v118: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.5 KiB/s wr, 19 op/s 2024-04-25T20:53:52.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:51 smithi043 ceph-mon[29167]: pgmap v119: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-25T20:53:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:51 smithi195 ceph-mon[33250]: pgmap v119: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-25T20:53:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:51 smithi112 ceph-mon[32322]: pgmap v119: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-25T20:53:54.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:53 smithi043 ceph-mon[29167]: pgmap v120: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:53:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:53 smithi195 ceph-mon[33250]: pgmap v120: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:53:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:53 smithi112 ceph-mon[32322]: pgmap v120: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-04-25T20:53:56.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:55 smithi043 ceph-mon[29167]: pgmap v121: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:53:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:55 smithi195 ceph-mon[33250]: pgmap v121: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:53:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:55 smithi112 ceph-mon[32322]: pgmap v121: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-04-25T20:53:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:57 smithi043 ceph-mon[29167]: pgmap v122: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:53:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:57 smithi195 ceph-mon[33250]: pgmap v122: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:53:58.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:57 smithi112 ceph-mon[32322]: pgmap v122: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:00.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:53:59 smithi043 ceph-mon[29167]: pgmap v123: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:00.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:53:59 smithi195 ceph-mon[33250]: pgmap v123: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:00.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:53:59 smithi112 ceph-mon[32322]: pgmap v123: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:02.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:01 smithi043 ceph-mon[29167]: pgmap v124: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:02.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:01 smithi195 ceph-mon[33250]: pgmap v124: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:02.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:01 smithi112 ceph-mon[32322]: pgmap v124: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:03 smithi043 ceph-mon[29167]: pgmap v125: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:04.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:03 smithi195 ceph-mon[33250]: pgmap v125: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:04.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:03 smithi112 ceph-mon[32322]: pgmap v125: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:06.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:05 smithi043 ceph-mon[29167]: pgmap v126: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:05 smithi195 ceph-mon[33250]: pgmap v126: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:06.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:05 smithi112 ceph-mon[32322]: pgmap v126: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:07.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:06 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:54:07.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:06 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:54:07.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:06 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:54:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:07 smithi043 ceph-mon[29167]: pgmap v127: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:07 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:54:08.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:07 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:54:08.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:07 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:54:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:07 smithi195 ceph-mon[33250]: pgmap v127: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:08.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:07 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:54:08.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:07 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:54:08.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:07 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:54:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:07 smithi112 ceph-mon[32322]: pgmap v127: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:07 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:54:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:07 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:54:08.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:07 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:54:10.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:09 smithi043 ceph-mon[29167]: pgmap v128: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T20:54:10.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:09 smithi195 ceph-mon[33250]: pgmap v128: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T20:54:10.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:09 smithi112 ceph-mon[32322]: pgmap v128: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T20:54:12.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:11 smithi043 ceph-mon[29167]: pgmap v129: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:54:12.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:11 smithi195 ceph-mon[33250]: pgmap v129: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:54:12.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:11 smithi112 ceph-mon[32322]: pgmap v129: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:54:14.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:13 smithi043 ceph-mon[29167]: pgmap v130: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:14.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:13 smithi195 ceph-mon[33250]: pgmap v130: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:14.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:13 smithi112 ceph-mon[32322]: pgmap v130: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:54:16.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:15 smithi043 ceph-mon[29167]: pgmap v131: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:16.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:15 smithi195 ceph-mon[33250]: pgmap v131: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:16.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:15 smithi112 ceph-mon[32322]: pgmap v131: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:54:18.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:17 smithi043 ceph-mon[29167]: pgmap v132: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:18.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:17 smithi195 ceph-mon[33250]: pgmap v132: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:18.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:17 smithi112 ceph-mon[32322]: pgmap v132: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:20.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:19 smithi043 ceph-mon[29167]: pgmap v133: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:20.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:19 smithi195 ceph-mon[33250]: pgmap v133: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:20.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:19 smithi112 ceph-mon[32322]: pgmap v133: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:54:22.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:21 smithi043 ceph-mon[29167]: pgmap v134: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:54:22.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:21 smithi195 ceph-mon[33250]: pgmap v134: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:54:22.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:21 smithi112 ceph-mon[32322]: pgmap v134: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:54:24.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:23 smithi043 ceph-mon[29167]: pgmap v135: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:24.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:23 smithi195 ceph-mon[33250]: pgmap v135: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:24.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:23 smithi112 ceph-mon[32322]: pgmap v135: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:26.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:25 smithi043 ceph-mon[29167]: pgmap v136: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:26.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:25 smithi195 ceph-mon[33250]: pgmap v136: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:26.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:25 smithi112 ceph-mon[32322]: pgmap v136: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:28.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:27 smithi043 ceph-mon[29167]: pgmap v137: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:28.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:27 smithi195 ceph-mon[33250]: pgmap v137: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:28.345 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:27 smithi112 ceph-mon[32322]: pgmap v137: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:30.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:29 smithi043 ceph-mon[29167]: pgmap v138: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:30.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:29 smithi195 ceph-mon[33250]: pgmap v138: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:30.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:29 smithi112 ceph-mon[32322]: pgmap v138: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:32.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:31 smithi043 ceph-mon[29167]: pgmap v139: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:32.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:31 smithi195 ceph-mon[33250]: pgmap v139: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:32.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:31 smithi112 ceph-mon[32322]: pgmap v139: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:34.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:33 smithi043 ceph-mon[29167]: pgmap v140: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:54:34.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:33 smithi195 ceph-mon[33250]: pgmap v140: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:54:34.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:33 smithi112 ceph-mon[32322]: pgmap v140: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:54:36.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:35 smithi043 ceph-mon[29167]: pgmap v141: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:36.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:35 smithi195 ceph-mon[33250]: pgmap v141: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:36.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:35 smithi112 ceph-mon[32322]: pgmap v141: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:38.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:37 smithi043 ceph-mon[29167]: pgmap v142: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:38.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:37 smithi195 ceph-mon[33250]: pgmap v142: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:38.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:37 smithi112 ceph-mon[32322]: pgmap v142: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:40.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:39 smithi043 ceph-mon[29167]: pgmap v143: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:40.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:39 smithi195 ceph-mon[33250]: pgmap v143: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:40.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:39 smithi112 ceph-mon[32322]: pgmap v143: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:42.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:41 smithi043 ceph-mon[29167]: pgmap v144: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:42.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:41 smithi195 ceph-mon[33250]: pgmap v144: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:42.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:41 smithi112 ceph-mon[32322]: pgmap v144: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:44.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:43 smithi043 ceph-mon[29167]: pgmap v145: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:44.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:43 smithi195 ceph-mon[33250]: pgmap v145: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:44.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:43 smithi112 ceph-mon[32322]: pgmap v145: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-25T20:54:46.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:45 smithi043 ceph-mon[29167]: pgmap v146: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:46.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:45 smithi195 ceph-mon[33250]: pgmap v146: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:46.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:45 smithi112 ceph-mon[32322]: pgmap v146: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-25T20:54:48.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:47 smithi043 ceph-mon[29167]: pgmap v147: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:48.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:47 smithi195 ceph-mon[33250]: pgmap v147: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:48.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:47 smithi112 ceph-mon[32322]: pgmap v147: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:50.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:49 smithi043 ceph-mon[29167]: pgmap v148: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:50.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:49 smithi195 ceph-mon[33250]: pgmap v148: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:50.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:49 smithi112 ceph-mon[32322]: pgmap v148: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:52.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:51 smithi043 ceph-mon[29167]: pgmap v149: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:52.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:51 smithi195 ceph-mon[33250]: pgmap v149: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:52.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:51 smithi112 ceph-mon[32322]: pgmap v149: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:54.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:53 smithi043 ceph-mon[29167]: pgmap v150: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:54.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:53 smithi195 ceph-mon[33250]: pgmap v150: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:54.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:53 smithi112 ceph-mon[32322]: pgmap v150: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:54:56.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:56 smithi043 ceph-mon[29167]: pgmap v151: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:56.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:56 smithi195 ceph-mon[33250]: pgmap v151: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:56.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:56 smithi112 ceph-mon[32322]: pgmap v151: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:54:58.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:54:58 smithi043 ceph-mon[29167]: pgmap v152: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:58.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:54:58 smithi195 ceph-mon[33250]: pgmap v152: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:54:58.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:54:58 smithi112 ceph-mon[32322]: pgmap v152: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:00.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:00 smithi043 ceph-mon[29167]: pgmap v153: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:00.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:00 smithi195 ceph-mon[33250]: pgmap v153: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:00.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:00 smithi112 ceph-mon[32322]: pgmap v153: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:02.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:02 smithi043 ceph-mon[29167]: pgmap v154: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:02.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:02 smithi195 ceph-mon[33250]: pgmap v154: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:02.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:02 smithi112 ceph-mon[32322]: pgmap v154: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:04 smithi043 ceph-mon[29167]: pgmap v155: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:04.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:04 smithi195 ceph-mon[33250]: pgmap v155: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:04.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:04 smithi112 ceph-mon[32322]: pgmap v155: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:06.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:06 smithi043 ceph-mon[29167]: pgmap v156: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:06.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:06 smithi195 ceph-mon[33250]: pgmap v156: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:06.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:06 smithi112 ceph-mon[32322]: pgmap v156: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:08 smithi043 ceph-mon[29167]: pgmap v157: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:08.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:08 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:55:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:08 smithi195 ceph-mon[33250]: pgmap v157: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:08.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:08 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:55:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:08 smithi112 ceph-mon[32322]: pgmap v157: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:08.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:08 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:55:09.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:55:09.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:55:09.295 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:55:09.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:55:09.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:55:09.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:55:09.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:55:09.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:55:09.342 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:55:10.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:10 smithi043 ceph-mon[29167]: pgmap v158: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:10.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:10 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:10.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:10 smithi195 ceph-mon[33250]: pgmap v158: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:10.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:10 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:10.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:10 smithi112 ceph-mon[32322]: pgmap v158: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:10.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:10 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:11.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:11 smithi043 ceph-mon[29167]: pgmap v159: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:55:11.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:11 smithi195 ceph-mon[33250]: pgmap v159: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:55:11.592 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:11 smithi112 ceph-mon[32322]: pgmap v159: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 30 op/s 2024-04-25T20:55:13.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:13 smithi195 ceph-mon[33250]: pgmap v160: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:13.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:13 smithi112 ceph-mon[32322]: pgmap v160: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:13 smithi043 ceph-mon[29167]: pgmap v160: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-25T20:55:15.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:15 smithi195 ceph-mon[33250]: pgmap v161: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:15.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:15 smithi112 ceph-mon[32322]: pgmap v161: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:15 smithi043 ceph-mon[29167]: pgmap v161: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-25T20:55:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:17 smithi195 ceph-mon[33250]: pgmap v162: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:17.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:17 smithi112 ceph-mon[32322]: pgmap v162: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:17 smithi043 ceph-mon[29167]: pgmap v162: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:19.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:19 smithi195 ceph-mon[33250]: pgmap v163: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:19.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:19 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:19 smithi112 ceph-mon[32322]: pgmap v163: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:19.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:19 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:19 smithi043 ceph-mon[29167]: pgmap v163: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-25T20:55:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:19 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:21.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:21 smithi112 ceph-mon[32322]: pgmap v164: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:55:21.842 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:21 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:21 smithi043 ceph-mon[29167]: pgmap v164: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:55:22.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:21 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:21 smithi195 ceph-mon[33250]: pgmap v164: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:55:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:21 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:23 smithi043 ceph-mon[29167]: pgmap v165: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:23 smithi195 ceph-mon[33250]: pgmap v165: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:23 smithi112 ceph-mon[32322]: pgmap v165: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:25 smithi043 ceph-mon[29167]: pgmap v166: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:25 smithi195 ceph-mon[33250]: pgmap v166: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:25 smithi112 ceph-mon[32322]: pgmap v166: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:27.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:26 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:27.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:26 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:27.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:26 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:27 smithi043 ceph-mon[29167]: pgmap v167: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:27 smithi195 ceph-mon[33250]: pgmap v167: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:27 smithi112 ceph-mon[32322]: pgmap v167: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:29 smithi043 ceph-mon[29167]: pgmap v168: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:29 smithi195 ceph-mon[33250]: pgmap v168: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:29 smithi112 ceph-mon[32322]: pgmap v168: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:31 smithi043 ceph-mon[29167]: pgmap v169: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:31 smithi195 ceph-mon[33250]: pgmap v169: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:31 smithi112 ceph-mon[32322]: pgmap v169: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:33.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:32 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:33.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:32 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:33.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:32 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:33 smithi043 ceph-mon[29167]: pgmap v170: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:33 smithi195 ceph-mon[33250]: pgmap v170: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:33 smithi112 ceph-mon[32322]: pgmap v170: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:35.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:34 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:35.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:34 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:35.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:34 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:35 smithi043 ceph-mon[29167]: pgmap v171: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:36.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:35 smithi195 ceph-mon[33250]: pgmap v171: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:35 smithi112 ceph-mon[32322]: pgmap v171: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:37 smithi043 ceph-mon[29167]: pgmap v172: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:37 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:37 smithi195 ceph-mon[33250]: pgmap v172: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:37 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:37 smithi112 ceph-mon[32322]: pgmap v172: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-04-25T20:55:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:37 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:39 smithi043 ceph-mon[29167]: pgmap v173: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:39 smithi195 ceph-mon[33250]: pgmap v173: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:39 smithi112 ceph-mon[32322]: pgmap v173: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:41 smithi043 ceph-mon[29167]: pgmap v174: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:41 smithi195 ceph-mon[33250]: pgmap v174: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:41 smithi112 ceph-mon[32322]: pgmap v174: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:43.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:42 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:43.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:42 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:42 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:43 smithi043 ceph-mon[29167]: pgmap v175: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:43 smithi195 ceph-mon[33250]: pgmap v175: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:43 smithi112 ceph-mon[32322]: pgmap v175: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:45.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:44 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:45.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:44 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:45.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:44 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:45 smithi043 ceph-mon[29167]: pgmap v176: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:45 smithi195 ceph-mon[33250]: pgmap v176: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:45 smithi112 ceph-mon[32322]: pgmap v176: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:47 smithi043 ceph-mon[29167]: pgmap v177: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:47 smithi195 ceph-mon[33250]: pgmap v177: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:47 smithi112 ceph-mon[32322]: pgmap v177: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:49 smithi043 ceph-mon[29167]: pgmap v178: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:49 smithi195 ceph-mon[33250]: pgmap v178: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:49 smithi112 ceph-mon[32322]: pgmap v178: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:55:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:51 smithi043 ceph-mon[29167]: pgmap v179: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:52.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:51 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:51 smithi195 ceph-mon[33250]: pgmap v179: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:51 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:51 smithi112 ceph-mon[32322]: pgmap v179: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:51 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:53.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:52 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:53.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:52 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:53.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:52 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:53 smithi043 ceph-mon[29167]: pgmap v180: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:55:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:53 smithi195 ceph-mon[33250]: pgmap v180: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:55:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:53 smithi112 ceph-mon[32322]: pgmap v180: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:55:55.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:54 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:55.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:54 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:54 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:55 smithi043 ceph-mon[29167]: pgmap v181: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:55 smithi195 ceph-mon[33250]: pgmap v181: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:55 smithi112 ceph-mon[32322]: pgmap v181: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:55:57.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:56 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:57.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:56 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:57.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:56 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:55:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:57 smithi043 ceph-mon[29167]: pgmap v182: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:55:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:57 smithi195 ceph-mon[33250]: pgmap v182: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:55:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:57 smithi112 ceph-mon[32322]: pgmap v182: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:55:59 smithi043 ceph-mon[29167]: pgmap v183: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:55:59 smithi195 ceph-mon[33250]: pgmap v183: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:55:59 smithi112 ceph-mon[32322]: pgmap v183: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:01 smithi043 ceph-mon[29167]: pgmap v184: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:01 smithi195 ceph-mon[33250]: pgmap v184: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:01 smithi112 ceph-mon[32322]: pgmap v184: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:03 smithi043 ceph-mon[29167]: pgmap v185: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:03 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:03 smithi195 ceph-mon[33250]: pgmap v185: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:03 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:03 smithi112 ceph-mon[32322]: pgmap v185: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:03 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:05.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:04 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:05.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:04 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:05.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:04 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:05 smithi043 ceph-mon[29167]: pgmap v186: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 32 op/s 2024-04-25T20:56:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:05 smithi195 ceph-mon[33250]: pgmap v186: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 32 op/s 2024-04-25T20:56:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:05 smithi112 ceph-mon[32322]: pgmap v186: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 32 op/s 2024-04-25T20:56:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:07 smithi043 ceph-mon[29167]: pgmap v187: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-04-25T20:56:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:07 smithi195 ceph-mon[33250]: pgmap v187: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-04-25T20:56:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:07 smithi112 ceph-mon[32322]: pgmap v187: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-04-25T20:56:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:08 smithi043 ceph-mon[29167]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T20:56:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:08 smithi043 ceph-mon[29167]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:08 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:56:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:08 smithi195 ceph-mon[33250]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T20:56:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:08 smithi195 ceph-mon[33250]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:09.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:08 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:56:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:08 smithi112 ceph-mon[32322]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T20:56:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:08 smithi112 ceph-mon[32322]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-25T20:56:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:08 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:56:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:09 smithi043 ceph-mon[29167]: pgmap v189: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:56:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:56:10.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:56:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:09 smithi195 ceph-mon[33250]: pgmap v189: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:56:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:56:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:56:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:09 smithi112 ceph-mon[32322]: pgmap v189: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:56:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:56:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:56:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:11 smithi043 ceph-mon[29167]: pgmap v190: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:11 smithi195 ceph-mon[33250]: pgmap v190: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:11 smithi112 ceph-mon[32322]: pgmap v190: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:13 smithi043 ceph-mon[29167]: pgmap v191: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:13 smithi043 ceph-mon[29167]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T20:56:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:13 smithi195 ceph-mon[33250]: pgmap v191: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:13 smithi195 ceph-mon[33250]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T20:56:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:13 smithi112 ceph-mon[32322]: pgmap v191: 97 pgs: 97 active+clean; 187 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-04-25T20:56:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:13 smithi112 ceph-mon[32322]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T20:56:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:15 smithi043 ceph-mon[29167]: pgmap v193: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:56:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:15 smithi195 ceph-mon[33250]: pgmap v193: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:56:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:15 smithi112 ceph-mon[32322]: pgmap v193: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:56:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:17 smithi043 ceph-mon[29167]: pgmap v194: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T20:56:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:17 smithi195 ceph-mon[33250]: pgmap v194: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T20:56:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:17 smithi112 ceph-mon[32322]: pgmap v194: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T20:56:19.894 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:19 smithi195 ceph-mon[33250]: pgmap v195: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:56:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:19 smithi043 ceph-mon[29167]: pgmap v195: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:56:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:19 smithi112 ceph-mon[32322]: pgmap v195: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:56:21.894 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:21 smithi112 ceph-mon[32322]: pgmap v196: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:21 smithi043 ceph-mon[29167]: pgmap v196: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:21 smithi195 ceph-mon[33250]: pgmap v196: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:23 smithi043 ceph-mon[29167]: pgmap v197: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:23 smithi195 ceph-mon[33250]: pgmap v197: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:23 smithi112 ceph-mon[32322]: pgmap v197: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:56:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:25 smithi043 ceph-mon[29167]: pgmap v198: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:56:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:25 smithi195 ceph-mon[33250]: pgmap v198: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:56:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:25 smithi112 ceph-mon[32322]: pgmap v198: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:56:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:27 smithi043 ceph-mon[29167]: pgmap v199: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:27 smithi195 ceph-mon[33250]: pgmap v199: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:27 smithi112 ceph-mon[32322]: pgmap v199: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:29 smithi043 ceph-mon[29167]: pgmap v200: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:29 smithi195 ceph-mon[33250]: pgmap v200: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:29 smithi112 ceph-mon[32322]: pgmap v200: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:31 smithi043 ceph-mon[29167]: pgmap v201: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:31 smithi195 ceph-mon[33250]: pgmap v201: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:31 smithi112 ceph-mon[32322]: pgmap v201: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:33 smithi043 ceph-mon[29167]: pgmap v202: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:33 smithi195 ceph-mon[33250]: pgmap v202: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:33 smithi112 ceph-mon[32322]: pgmap v202: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:35 smithi043 ceph-mon[29167]: pgmap v203: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:36.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:35 smithi195 ceph-mon[33250]: pgmap v203: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:35 smithi112 ceph-mon[32322]: pgmap v203: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:37 smithi043 ceph-mon[29167]: pgmap v204: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:37 smithi195 ceph-mon[33250]: pgmap v204: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:37 smithi112 ceph-mon[32322]: pgmap v204: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:39 smithi043 ceph-mon[29167]: pgmap v205: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:39 smithi195 ceph-mon[33250]: pgmap v205: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:39 smithi112 ceph-mon[32322]: pgmap v205: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:41 smithi043 ceph-mon[29167]: pgmap v206: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:41 smithi195 ceph-mon[33250]: pgmap v206: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:41 smithi112 ceph-mon[32322]: pgmap v206: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:43 smithi043 ceph-mon[29167]: pgmap v207: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:43 smithi195 ceph-mon[33250]: pgmap v207: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:43 smithi112 ceph-mon[32322]: pgmap v207: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:45 smithi043 ceph-mon[29167]: pgmap v208: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:45 smithi195 ceph-mon[33250]: pgmap v208: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:45 smithi112 ceph-mon[32322]: pgmap v208: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:47 smithi043 ceph-mon[29167]: pgmap v209: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:47 smithi195 ceph-mon[33250]: pgmap v209: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:47 smithi112 ceph-mon[32322]: pgmap v209: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:49 smithi043 ceph-mon[29167]: pgmap v210: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:49 smithi195 ceph-mon[33250]: pgmap v210: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:49 smithi112 ceph-mon[32322]: pgmap v210: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:51 smithi043 ceph-mon[29167]: pgmap v211: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:52.136 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:51 smithi112 ceph-mon[32322]: pgmap v211: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:52.136 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:51 smithi195 ceph-mon[33250]: pgmap v211: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:53 smithi043 ceph-mon[29167]: pgmap v212: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:53 smithi195 ceph-mon[33250]: pgmap v212: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:53 smithi112 ceph-mon[32322]: pgmap v212: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-25T20:56:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:55 smithi043 ceph-mon[29167]: pgmap v213: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:55 smithi195 ceph-mon[33250]: pgmap v213: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:55 smithi112 ceph-mon[32322]: pgmap v213: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:56:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:57 smithi043 ceph-mon[29167]: pgmap v214: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:57 smithi195 ceph-mon[33250]: pgmap v214: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:56:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:57 smithi112 ceph-mon[32322]: pgmap v214: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:56:59 smithi043 ceph-mon[29167]: pgmap v215: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:56:59 smithi195 ceph-mon[33250]: pgmap v215: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:56:59 smithi112 ceph-mon[32322]: pgmap v215: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:01 smithi043 ceph-mon[29167]: pgmap v216: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:01 smithi195 ceph-mon[33250]: pgmap v216: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:01 smithi112 ceph-mon[32322]: pgmap v216: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:03 smithi043 ceph-mon[29167]: pgmap v217: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:03 smithi195 ceph-mon[33250]: pgmap v217: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:03 smithi112 ceph-mon[32322]: pgmap v217: 97 pgs: 97 active+clean; 187 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:05 smithi043 ceph-mon[29167]: pgmap v218: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:57:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:05 smithi195 ceph-mon[33250]: pgmap v218: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:57:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:05 smithi112 ceph-mon[32322]: pgmap v218: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:57:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:07 smithi043 ceph-mon[29167]: pgmap v219: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:57:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:07 smithi195 ceph-mon[33250]: pgmap v219: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:57:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:07 smithi112 ceph-mon[32322]: pgmap v219: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:57:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:08 smithi043 ceph-mon[29167]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T20:57:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:08 smithi195 ceph-mon[33250]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T20:57:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:08 smithi112 ceph-mon[32322]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T20:57:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:09 smithi043 ceph-mon[29167]: pgmap v221: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:09 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:57:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:09 smithi195 ceph-mon[33250]: pgmap v221: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:09 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:57:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:09 smithi112 ceph-mon[32322]: pgmap v221: 97 pgs: 97 active+clean; 187 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:09 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:57:11.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:10 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:57:11.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:10 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:57:11.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:10 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:57:11.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:10 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:57:11.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:10 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:57:11.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:10 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:57:11.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:10 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:57:11.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:10 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:57:11.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:10 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:57:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:11 smithi043 ceph-mon[29167]: pgmap v222: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:11 smithi195 ceph-mon[33250]: pgmap v222: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:11 smithi112 ceph-mon[32322]: pgmap v222: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:13 smithi043 ceph-mon[29167]: pgmap v223: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:14.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:13 smithi043 ceph-mon[29167]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T20:57:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:13 smithi195 ceph-mon[33250]: pgmap v223: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:13 smithi195 ceph-mon[33250]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T20:57:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:13 smithi112 ceph-mon[32322]: pgmap v223: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:57:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:13 smithi112 ceph-mon[32322]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T20:57:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:15 smithi043 ceph-mon[29167]: pgmap v225: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:57:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:15 smithi195 ceph-mon[33250]: pgmap v225: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:57:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:15 smithi112 ceph-mon[32322]: pgmap v225: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:57:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:17 smithi043 ceph-mon[29167]: pgmap v226: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:57:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:17 smithi195 ceph-mon[33250]: pgmap v226: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:57:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:17 smithi112 ceph-mon[32322]: pgmap v226: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:57:19.894 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:19 smithi195 ceph-mon[33250]: pgmap v227: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:57:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:19 smithi043 ceph-mon[29167]: pgmap v227: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:57:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:19 smithi112 ceph-mon[32322]: pgmap v227: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:57:21.895 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:21 smithi112 ceph-mon[32322]: pgmap v228: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:21 smithi043 ceph-mon[29167]: pgmap v228: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:21 smithi195 ceph-mon[33250]: pgmap v228: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:23 smithi043 ceph-mon[29167]: pgmap v229: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:23 smithi195 ceph-mon[33250]: pgmap v229: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:23 smithi112 ceph-mon[32322]: pgmap v229: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2024-04-25T20:57:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:25 smithi043 ceph-mon[29167]: pgmap v230: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:57:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:25 smithi195 ceph-mon[33250]: pgmap v230: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:57:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:25 smithi112 ceph-mon[32322]: pgmap v230: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:57:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:27 smithi043 ceph-mon[29167]: pgmap v231: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:27 smithi195 ceph-mon[33250]: pgmap v231: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:27 smithi112 ceph-mon[32322]: pgmap v231: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:29 smithi043 ceph-mon[29167]: pgmap v232: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:29 smithi195 ceph-mon[33250]: pgmap v232: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:29 smithi112 ceph-mon[32322]: pgmap v232: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:31 smithi043 ceph-mon[29167]: pgmap v233: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:31 smithi195 ceph-mon[33250]: pgmap v233: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:31 smithi112 ceph-mon[32322]: pgmap v233: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:33 smithi043 ceph-mon[29167]: pgmap v234: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:33 smithi195 ceph-mon[33250]: pgmap v234: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:33 smithi112 ceph-mon[32322]: pgmap v234: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:35 smithi043 ceph-mon[29167]: pgmap v235: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:36.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:35 smithi195 ceph-mon[33250]: pgmap v235: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:35 smithi112 ceph-mon[32322]: pgmap v235: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:37 smithi043 ceph-mon[29167]: pgmap v236: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:37 smithi195 ceph-mon[33250]: pgmap v236: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:37 smithi112 ceph-mon[32322]: pgmap v236: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:40.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:39 smithi043 ceph-mon[29167]: pgmap v237: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:39 smithi195 ceph-mon[33250]: pgmap v237: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:39 smithi112 ceph-mon[32322]: pgmap v237: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:41 smithi043 ceph-mon[29167]: pgmap v238: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:41 smithi195 ceph-mon[33250]: pgmap v238: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:41 smithi112 ceph-mon[32322]: pgmap v238: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:43 smithi043 ceph-mon[29167]: pgmap v239: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:43 smithi195 ceph-mon[33250]: pgmap v239: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:43 smithi112 ceph-mon[32322]: pgmap v239: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:45 smithi043 ceph-mon[29167]: pgmap v240: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:45 smithi195 ceph-mon[33250]: pgmap v240: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:45 smithi112 ceph-mon[32322]: pgmap v240: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:47 smithi043 ceph-mon[29167]: pgmap v241: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:47 smithi195 ceph-mon[33250]: pgmap v241: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:47 smithi112 ceph-mon[32322]: pgmap v241: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:49 smithi043 ceph-mon[29167]: pgmap v242: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:49 smithi195 ceph-mon[33250]: pgmap v242: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:49 smithi112 ceph-mon[32322]: pgmap v242: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:51 smithi043 ceph-mon[29167]: pgmap v243: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:51 smithi195 ceph-mon[33250]: pgmap v243: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:51 smithi112 ceph-mon[32322]: pgmap v243: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:53 smithi043 ceph-mon[29167]: pgmap v244: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:53 smithi195 ceph-mon[33250]: pgmap v244: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:53 smithi112 ceph-mon[32322]: pgmap v244: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:55 smithi043 ceph-mon[29167]: pgmap v245: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:55 smithi195 ceph-mon[33250]: pgmap v245: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:55 smithi112 ceph-mon[32322]: pgmap v245: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:57:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:57 smithi043 ceph-mon[29167]: pgmap v246: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:57 smithi195 ceph-mon[33250]: pgmap v246: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:57:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:57 smithi112 ceph-mon[32322]: pgmap v246: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:57:59 smithi043 ceph-mon[29167]: pgmap v247: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:57:59 smithi195 ceph-mon[33250]: pgmap v247: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:57:59 smithi112 ceph-mon[32322]: pgmap v247: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:01 smithi043 ceph-mon[29167]: pgmap v248: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:01 smithi195 ceph-mon[33250]: pgmap v248: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:01 smithi112 ceph-mon[32322]: pgmap v248: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:03 smithi043 ceph-mon[29167]: pgmap v249: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:03 smithi195 ceph-mon[33250]: pgmap v249: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:03 smithi112 ceph-mon[32322]: pgmap v249: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:05 smithi043 ceph-mon[29167]: pgmap v250: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:58:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:05 smithi195 ceph-mon[33250]: pgmap v250: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:58:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:05 smithi112 ceph-mon[32322]: pgmap v250: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:58:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:07 smithi043 ceph-mon[29167]: pgmap v251: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:58:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:07 smithi195 ceph-mon[33250]: pgmap v251: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:58:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:07 smithi112 ceph-mon[32322]: pgmap v251: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:58:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:08 smithi043 ceph-mon[29167]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T20:58:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:08 smithi195 ceph-mon[33250]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T20:58:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:08 smithi112 ceph-mon[32322]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T20:58:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:09 smithi043 ceph-mon[29167]: pgmap v253: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:09 smithi195 ceph-mon[33250]: pgmap v253: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:09 smithi112 ceph-mon[32322]: pgmap v253: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:11.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:10 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:58:11.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:10 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:58:11.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:10 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:58:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:11 smithi043 ceph-mon[29167]: pgmap v254: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:11 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:58:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:11 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:58:12.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:11 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:58:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:11 smithi195 ceph-mon[33250]: pgmap v254: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:11 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:58:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:11 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:58:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:11 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:58:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:11 smithi112 ceph-mon[32322]: pgmap v254: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:11 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:58:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:11 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:58:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:11 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:58:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:13 smithi043 ceph-mon[29167]: pgmap v255: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:13 smithi043 ceph-mon[29167]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T20:58:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:13 smithi195 ceph-mon[33250]: pgmap v255: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:13 smithi195 ceph-mon[33250]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T20:58:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:13 smithi112 ceph-mon[32322]: pgmap v255: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:58:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:13 smithi112 ceph-mon[32322]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T20:58:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:15 smithi043 ceph-mon[29167]: pgmap v257: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:58:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:15 smithi195 ceph-mon[33250]: pgmap v257: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:58:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:15 smithi112 ceph-mon[32322]: pgmap v257: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:58:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:17 smithi043 ceph-mon[29167]: pgmap v258: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:58:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:17 smithi195 ceph-mon[33250]: pgmap v258: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:58:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:17 smithi112 ceph-mon[32322]: pgmap v258: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:58:19.894 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:19 smithi195 ceph-mon[33250]: pgmap v259: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:58:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:19 smithi043 ceph-mon[29167]: pgmap v259: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:58:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:19 smithi112 ceph-mon[32322]: pgmap v259: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:58:21.894 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:21 smithi112 ceph-mon[32322]: pgmap v260: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:21 smithi043 ceph-mon[29167]: pgmap v260: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:21 smithi195 ceph-mon[33250]: pgmap v260: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:23 smithi043 ceph-mon[29167]: pgmap v261: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:23 smithi195 ceph-mon[33250]: pgmap v261: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:23 smithi112 ceph-mon[32322]: pgmap v261: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:58:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:25 smithi043 ceph-mon[29167]: pgmap v262: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:58:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:25 smithi195 ceph-mon[33250]: pgmap v262: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:58:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:25 smithi112 ceph-mon[32322]: pgmap v262: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:58:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:27 smithi043 ceph-mon[29167]: pgmap v263: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:27 smithi195 ceph-mon[33250]: pgmap v263: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:27 smithi112 ceph-mon[32322]: pgmap v263: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:29 smithi043 ceph-mon[29167]: pgmap v264: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:29 smithi195 ceph-mon[33250]: pgmap v264: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:29 smithi112 ceph-mon[32322]: pgmap v264: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:31 smithi043 ceph-mon[29167]: pgmap v265: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:31 smithi195 ceph-mon[33250]: pgmap v265: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:31 smithi112 ceph-mon[32322]: pgmap v265: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:33 smithi043 ceph-mon[29167]: pgmap v266: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:33 smithi195 ceph-mon[33250]: pgmap v266: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:33 smithi112 ceph-mon[32322]: pgmap v266: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:35 smithi043 ceph-mon[29167]: pgmap v267: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:36.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:35 smithi195 ceph-mon[33250]: pgmap v267: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:35 smithi112 ceph-mon[32322]: pgmap v267: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:37 smithi043 ceph-mon[29167]: pgmap v268: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:37 smithi195 ceph-mon[33250]: pgmap v268: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:37 smithi112 ceph-mon[32322]: pgmap v268: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:39 smithi043 ceph-mon[29167]: pgmap v269: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:39 smithi195 ceph-mon[33250]: pgmap v269: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:39 smithi112 ceph-mon[32322]: pgmap v269: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:41 smithi043 ceph-mon[29167]: pgmap v270: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:41 smithi195 ceph-mon[33250]: pgmap v270: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:41 smithi112 ceph-mon[32322]: pgmap v270: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:43 smithi043 ceph-mon[29167]: pgmap v271: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:43 smithi195 ceph-mon[33250]: pgmap v271: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:43 smithi112 ceph-mon[32322]: pgmap v271: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:45 smithi043 ceph-mon[29167]: pgmap v272: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:45 smithi195 ceph-mon[33250]: pgmap v272: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:45 smithi112 ceph-mon[32322]: pgmap v272: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:47 smithi043 ceph-mon[29167]: pgmap v273: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:47 smithi195 ceph-mon[33250]: pgmap v273: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:47 smithi112 ceph-mon[32322]: pgmap v273: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:49 smithi043 ceph-mon[29167]: pgmap v274: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:49 smithi195 ceph-mon[33250]: pgmap v274: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:49 smithi112 ceph-mon[32322]: pgmap v274: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:51 smithi043 ceph-mon[29167]: pgmap v275: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:51 smithi195 ceph-mon[33250]: pgmap v275: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:51 smithi112 ceph-mon[32322]: pgmap v275: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:53 smithi043 ceph-mon[29167]: pgmap v276: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:53 smithi195 ceph-mon[33250]: pgmap v276: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:53 smithi112 ceph-mon[32322]: pgmap v276: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:55 smithi043 ceph-mon[29167]: pgmap v277: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:55 smithi195 ceph-mon[33250]: pgmap v277: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:55 smithi112 ceph-mon[32322]: pgmap v277: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:58:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:57 smithi043 ceph-mon[29167]: pgmap v278: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:57 smithi195 ceph-mon[33250]: pgmap v278: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:58:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:57 smithi112 ceph-mon[32322]: pgmap v278: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:58:59 smithi043 ceph-mon[29167]: pgmap v279: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:58:59 smithi195 ceph-mon[33250]: pgmap v279: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:58:59 smithi112 ceph-mon[32322]: pgmap v279: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:02.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:01 smithi043 ceph-mon[29167]: pgmap v280: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:01 smithi195 ceph-mon[33250]: pgmap v280: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:01 smithi112 ceph-mon[32322]: pgmap v280: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:03 smithi043 ceph-mon[29167]: pgmap v281: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:03 smithi195 ceph-mon[33250]: pgmap v281: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:03 smithi112 ceph-mon[32322]: pgmap v281: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:06.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:05 smithi043 ceph-mon[29167]: pgmap v282: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:59:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:05 smithi195 ceph-mon[33250]: pgmap v282: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:59:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:05 smithi112 ceph-mon[32322]: pgmap v282: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 32 op/s 2024-04-25T20:59:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:07 smithi043 ceph-mon[29167]: pgmap v283: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:59:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:07 smithi195 ceph-mon[33250]: pgmap v283: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:59:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:07 smithi112 ceph-mon[32322]: pgmap v283: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T20:59:09.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:08 smithi043 ceph-mon[29167]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T20:59:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:08 smithi195 ceph-mon[33250]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T20:59:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:08 smithi112 ceph-mon[32322]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T20:59:10.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:09 smithi043 ceph-mon[29167]: pgmap v285: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:09 smithi195 ceph-mon[33250]: pgmap v285: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:09 smithi112 ceph-mon[32322]: pgmap v285: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:11 smithi043 ceph-mon[29167]: pgmap v286: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:12.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:11 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:59:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:11 smithi195 ceph-mon[33250]: pgmap v286: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:11 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:59:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:11 smithi112 ceph-mon[32322]: pgmap v286: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:11 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T20:59:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:59:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:59:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:59:13.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:12 smithi043 ceph-mon[29167]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T20:59:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:59:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:59:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:59:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:12 smithi195 ceph-mon[33250]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T20:59:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T20:59:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T20:59:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T20:59:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:12 smithi112 ceph-mon[32322]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T20:59:14.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:13 smithi043 ceph-mon[29167]: pgmap v287: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:13 smithi195 ceph-mon[33250]: pgmap v287: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:13 smithi112 ceph-mon[32322]: pgmap v287: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-25T20:59:16.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:15 smithi043 ceph-mon[29167]: pgmap v289: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:59:16.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:15 smithi195 ceph-mon[33250]: pgmap v289: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:59:16.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:15 smithi112 ceph-mon[32322]: pgmap v289: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T20:59:18.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:17 smithi043 ceph-mon[29167]: pgmap v290: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:59:18.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:17 smithi195 ceph-mon[33250]: pgmap v290: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:59:18.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:17 smithi112 ceph-mon[32322]: pgmap v290: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 230 B/s wr, 13 op/s 2024-04-25T20:59:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:19 smithi043 ceph-mon[29167]: pgmap v291: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:59:20.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:19 smithi195 ceph-mon[33250]: pgmap v291: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:59:20.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:19 smithi112 ceph-mon[32322]: pgmap v291: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T20:59:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:21 smithi043 ceph-mon[29167]: pgmap v292: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:21 smithi195 ceph-mon[33250]: pgmap v292: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:22.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:21 smithi112 ceph-mon[32322]: pgmap v292: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:23 smithi043 ceph-mon[29167]: pgmap v293: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:23 smithi195 ceph-mon[33250]: pgmap v293: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:24.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:23 smithi112 ceph-mon[32322]: pgmap v293: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T20:59:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:25 smithi043 ceph-mon[29167]: pgmap v294: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:59:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:25 smithi195 ceph-mon[33250]: pgmap v294: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:59:26.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:25 smithi112 ceph-mon[32322]: pgmap v294: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T20:59:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:27 smithi043 ceph-mon[29167]: pgmap v295: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:28.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:27 smithi195 ceph-mon[33250]: pgmap v295: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:28.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:27 smithi112 ceph-mon[32322]: pgmap v295: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:29 smithi043 ceph-mon[29167]: pgmap v296: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:30.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:29 smithi195 ceph-mon[33250]: pgmap v296: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:29 smithi112 ceph-mon[32322]: pgmap v296: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:31 smithi043 ceph-mon[29167]: pgmap v297: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:32.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:31 smithi195 ceph-mon[33250]: pgmap v297: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:31 smithi112 ceph-mon[32322]: pgmap v297: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:33 smithi043 ceph-mon[29167]: pgmap v298: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:34.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:33 smithi195 ceph-mon[33250]: pgmap v298: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:33 smithi112 ceph-mon[32322]: pgmap v298: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:35 smithi043 ceph-mon[29167]: pgmap v299: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:36.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:35 smithi195 ceph-mon[33250]: pgmap v299: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:35 smithi112 ceph-mon[32322]: pgmap v299: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:37 smithi043 ceph-mon[29167]: pgmap v300: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:38.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:37 smithi195 ceph-mon[33250]: pgmap v300: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:37 smithi112 ceph-mon[32322]: pgmap v300: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:39 smithi043 ceph-mon[29167]: pgmap v301: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:39 smithi195 ceph-mon[33250]: pgmap v301: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:39 smithi112 ceph-mon[32322]: pgmap v301: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:42.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:41 smithi043 ceph-mon[29167]: pgmap v302: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:41 smithi195 ceph-mon[33250]: pgmap v302: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:41 smithi112 ceph-mon[32322]: pgmap v302: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:44.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:43 smithi043 ceph-mon[29167]: pgmap v303: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:43 smithi195 ceph-mon[33250]: pgmap v303: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:43 smithi112 ceph-mon[32322]: pgmap v303: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:46.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:45 smithi043 ceph-mon[29167]: pgmap v304: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:45 smithi195 ceph-mon[33250]: pgmap v304: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:45 smithi112 ceph-mon[32322]: pgmap v304: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:48.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:47 smithi043 ceph-mon[29167]: pgmap v305: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:47 smithi195 ceph-mon[33250]: pgmap v305: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:47 smithi112 ceph-mon[32322]: pgmap v305: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:49 smithi043 ceph-mon[29167]: pgmap v306: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:49 smithi195 ceph-mon[33250]: pgmap v306: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:49 smithi112 ceph-mon[32322]: pgmap v306: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:52.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:51 smithi043 ceph-mon[29167]: pgmap v307: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:51 smithi195 ceph-mon[33250]: pgmap v307: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:51 smithi112 ceph-mon[32322]: pgmap v307: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:53 smithi043 ceph-mon[29167]: pgmap v308: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:53 smithi195 ceph-mon[33250]: pgmap v308: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:53 smithi112 ceph-mon[32322]: pgmap v308: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:55 smithi043 ceph-mon[29167]: pgmap v309: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:55 smithi195 ceph-mon[33250]: pgmap v309: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:56.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:55 smithi112 ceph-mon[32322]: pgmap v309: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T20:59:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:57 smithi043 ceph-mon[29167]: pgmap v310: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:57 smithi195 ceph-mon[33250]: pgmap v310: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T20:59:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:57 smithi112 ceph-mon[32322]: pgmap v310: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 20:59:59 smithi195 ceph-mon[33250]: pgmap v311: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 20:59:59 smithi112 ceph-mon[32322]: pgmap v311: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:00.280 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 20:59:59 smithi043 ceph-mon[29167]: pgmap v311: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:00.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T21:00:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- 172.21.15.43:0/2747294395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 msgr2=0x7f6c7c1025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- 172.21.15.43:0/2747294395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c1025a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009900 tx=0x7f6c6c02a410 comp rx=0 tx=0).stop 2024-04-25T21:00:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- 172.21.15.43:0/2747294395 shutdown_connections 2024-04-25T21:00:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- 172.21.15.43:0/2747294395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- 172.21.15.43:0/2747294395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c7c102b70 0x7f6c7c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- 172.21.15.43:0/2747294395 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c1025a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- 172.21.15.43:0/2747294395 >> 172.21.15.43:0/2747294395 conn(0x7f6c7c0fda20 msgr2=0x7f6c7c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- 172.21.15.43:0/2747294395 shutdown_connections 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- 172.21.15.43:0/2747294395 wait complete. 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 Processor -- start 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 -- start start 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.402+0000 7f6c831c4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c7c074cd0 0x7f6c7c1a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c831c4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c112310 con 0x7f6c7c1021c0 2024-04-25T21:00:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c831c4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c112190 con 0x7f6c7c107290 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c831c4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c112490 con 0x7f6c7c074cd0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33744/0 (socket says 172.21.15.43:33744) 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 -- 172.21.15.43:0/401419108 learned_addr learned my addr 172.21.15.43:0/401419108 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c7bfff640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 -- 172.21.15.43:0/401419108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c7c074cd0 msgr2=0x7f6c7c1a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c7c074cd0 0x7f6c7c1a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 -- 172.21.15.43:0/401419108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 msgr2=0x7f6c7c074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 -- 172.21.15.43:0/401419108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1a7120 con 0x7f6c7c1021c0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c7bfff640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c80f60640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c005ab0 tx=0x7f6c6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c03f030 con 0x7f6c7c1021c0 2024-04-25T21:00:00.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6c6c003cd0 con 0x7f6c7c1021c0 2024-04-25T21:00:00.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c1a73b0 con 0x7f6c7c1021c0 2024-04-25T21:00:00.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.403+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c035070 con 0x7f6c7c1021c0 2024-04-25T21:00:00.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.404+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1a78f0 con 0x7f6c7c1021c0 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.404+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c04fce0 con 0x7f6c7c1021c0 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.406+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6c6c042030 con 0x7f6c7c1021c0 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.407+0000 7f6c79ffb640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 0x7f6c680a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.407+0000 7f6c7bfff640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 0x7f6c680a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.407+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f6c6c0f0f60 con 0x7f6c7c1021c0 2024-04-25T21:00:00.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.407+0000 7f6c7bfff640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 0x7f6c680a6300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c075c90 tx=0x7f6c64005e50 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:00.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.411+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c6c0bd600 con 0x7f6c7c1021c0 2024-04-25T21:00:00.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.623+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6c7c102b70 con 0x7f6c680a3e40 2024-04-25T21:00:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.631+0000 7f6c79ffb640 1 -- 172.21.15.43:0/401419108 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f6c7c102b70 con 0x7f6c680a3e40 2024-04-25T21:00:00.631 INFO:teuthology.orchestra.run.smithi043.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T20:49:59", "first": "2024-04-25T20:50:00", "last": "2024-04-25T20:59:00", "last_pruned": "2024-04-25T20:59:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-25T21:00:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 msgr2=0x7f6c680a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 0x7f6c680a6300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c075c90 tx=0x7f6c64005e50 comp rx=0 tx=0).stop 2024-04-25T21:00:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 msgr2=0x7f6c7c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c005ab0 tx=0x7f6c6c0042f0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 shutdown_connections 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6c680a3e40 0x7f6c680a6300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c7c074cd0 0x7f6c7c1a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c7c107290 0x7f6c7c074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 --2- 172.21.15.43:0/401419108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c7c1021c0 0x7f6c7c074250 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 >> 172.21.15.43:0/401419108 conn(0x7f6c7c0fda20 msgr2=0x7f6c7c0ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 shutdown_connections 2024-04-25T21:00:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.633+0000 7f6c831c4640 1 -- 172.21.15.43:0/401419108 wait complete. 2024-04-25T21:00:00.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T21:00:00.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 -- 172.21.15.43:0/942957472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb4101aa0 msgr2=0x7effb4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 --2- 172.21.15.43:0/942957472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb4101aa0 0x7effb4105a90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009900 tx=0x7eff9c02a410 comp rx=0 tx=0).stop 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 -- 172.21.15.43:0/942957472 shutdown_connections 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 --2- 172.21.15.43:0/942957472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb4106170 0x7effb410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 --2- 172.21.15.43:0/942957472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb4101aa0 0x7effb4105a90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 --2- 172.21.15.43:0/942957472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb41010f0 0x7effb41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 -- 172.21.15.43:0/942957472 >> 172.21.15.43:0/942957472 conn(0x7effb4077fd0 msgr2=0x7effb40783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 -- 172.21.15.43:0/942957472 shutdown_connections 2024-04-25T21:00:00.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.756+0000 7effb8d44640 1 -- 172.21.15.43:0/942957472 wait complete. 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 Processor -- start 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 -- start start 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 0x7effb4102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4106170 0x7effb4103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effb41111f0 con 0x7effb41035b0 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7effb4111070 con 0x7effb4106170 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb8d44640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7effb4111370 con 0x7effb41010f0 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb2d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb2d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33768/0 (socket says 172.21.15.43:33768) 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb2d9d640 1 -- 172.21.15.43:0/779739183 learned_addr learned my addr 172.21.15.43:0/779739183 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effb259c640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 0x7effb4102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.757+0000 7effa9d9b640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4106170 0x7effb4103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 -- 172.21.15.43:0/779739183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 msgr2=0x7effb4102b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 0x7effb4102b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 -- 172.21.15.43:0/779739183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4106170 msgr2=0x7effb4103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4106170 0x7effb4103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 -- 172.21.15.43:0/779739183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb41a7060 con 0x7effb41035b0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb259c640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 0x7effb4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb2d9d640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7effac00eaa0 tx=0x7effac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac00cdb0 con 0x7effb41035b0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effac005020 con 0x7effb41035b0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0116d0 con 0x7effb41035b0 2024-04-25T21:00:00.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb41a7350 con 0x7effb41035b0 2024-04-25T21:00:00.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.758+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41a7870 con 0x7effb41035b0 2024-04-25T21:00:00.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.759+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb404fce0 con 0x7effb41035b0 2024-04-25T21:00:00.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.761+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7effac0051d0 con 0x7effb41035b0 2024-04-25T21:00:00.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.761+0000 7effabfff640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 0x7effa00a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:00.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.761+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7effac0d0cb0 con 0x7effb41035b0 2024-04-25T21:00:00.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.761+0000 7effb259c640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 0x7effa00a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:00.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.762+0000 7effb259c640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 0x7effa00a62b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effa4005d00 tx=0x7effa400b410 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:00.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.766+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7effac016030 con 0x7effb41035b0 2024-04-25T21:00:00.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.978+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 --> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7effb410a480 con 0x7effa00a3df0 2024-04-25T21:00:00.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.985+0000 7effabfff640 1 -- 172.21.15.43:0/779739183 <== mgr.24908 v2:172.21.15.43:6800/1773585199 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7effa400bc80 con 0x7effa00a3df0 2024-04-25T21:00:00.985 INFO:teuthology.orchestra.run.smithi043.stdout:/ 1m 6m3h 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.986+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 msgr2=0x7effa00a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.986+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 0x7effa00a62b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effa4005d00 tx=0x7effa400b410 comp rx=0 tx=0).stop 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.986+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 msgr2=0x7effb41a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.986+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7effac00eaa0 tx=0x7effac00ef60 comp rx=0 tx=0).stop 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 shutdown_connections 2024-04-25T21:00:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7effa00a3df0 0x7effa00a62b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb41035b0 0x7effb41a6960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7effb4106170 0x7effb4103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 --2- 172.21.15.43:0/779739183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effb41010f0 0x7effb4102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 >> 172.21.15.43:0/779739183 conn(0x7effb4077fd0 msgr2=0x7effb40698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 shutdown_connections 2024-04-25T21:00:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:00.987+0000 7effb8d44640 1 -- 172.21.15.43:0/779739183 wait complete. 2024-04-25T21:00:00.996 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:00 smithi043 ceph-mon[29167]: overall HEALTH_OK 2024-04-25T21:00:00.998 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T21:00:01.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T21:00:01.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:00 smithi195 ceph-mon[33250]: overall HEALTH_OK 2024-04-25T21:00:01.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:00 smithi112 ceph-mon[32322]: overall HEALTH_OK 2024-04-25T21:00:01.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- 172.21.15.43:0/2351263352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a0101110 msgr2=0x7f37a01014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2351263352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a0101110 0x7f37a01014f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f379c009900 tx=0x7f379c02a410 comp rx=0 tx=0).stop 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- 172.21.15.43:0/2351263352 shutdown_connections 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2351263352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0106190 0x7f37a010dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2351263352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0101ac0 0x7f37a0105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2351263352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a0101110 0x7f37a01014f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- 172.21.15.43:0/2351263352 >> 172.21.15.43:0/2351263352 conn(0x7f37a0077fb0 msgr2=0x7f37a00783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- 172.21.15.43:0/2351263352 shutdown_connections 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- 172.21.15.43:0/2351263352 wait complete. 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 Processor -- start 2024-04-25T21:00:01.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.112+0000 7f37a7acf640 1 -- start start 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0101110 0x7f37a01976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 0x7f37a0197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37a0111230 con 0x7f37a019bf70 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37a01110b0 con 0x7f37a0106190 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f37a01113b0 con 0x7f37a0101110 2024-04-25T21:00:01.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33782/0 (socket says 172.21.15.43:33782) 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 -- 172.21.15.43:0/2308242808 learned_addr learned my addr 172.21.15.43:0/2308242808 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a586b640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0101110 0x7f37a01976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a506a640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 0x7f37a0197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 -- 172.21.15.43:0/2308242808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0101110 msgr2=0x7f37a01976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0101110 0x7f37a01976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 -- 172.21.15.43:0/2308242808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 msgr2=0x7f37a0197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 0x7f37a0197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 -- 172.21.15.43:0/2308242808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a019ca60 con 0x7f37a019bf70 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a506a640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 0x7f37a0197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a606c640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f379800e960 tx=0x7f379800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798004d20 con 0x7f37a019bf70 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3798005020 con 0x7f37a019bf70 2024-04-25T21:00:01.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a019cd50 con 0x7f37a019bf70 2024-04-25T21:00:01.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.113+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37980116d0 con 0x7f37a019bf70 2024-04-25T21:00:01.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.114+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a01a4540 con 0x7f37a019bf70 2024-04-25T21:00:01.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.114+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a00691c0 con 0x7f37a019bf70 2024-04-25T21:00:01.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.116+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f37980051d0 con 0x7f37a019bf70 2024-04-25T21:00:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.116+0000 7f3796ffd640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 0x7f378c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.116+0000 7f37a586b640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 0x7f378c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.116+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f37980d0c70 con 0x7f37a019bf70 2024-04-25T21:00:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.117+0000 7f37a586b640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 0x7f378c0a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f379c009230 tx=0x7f379c0058d0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.121+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3798016030 con 0x7f37a019bf70 2024-04-25T21:00:01.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.312+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37a0101ac0 con 0x7f37a019bf70 2024-04-25T21:00:01.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.313+0000 7f3796ffd640 1 -- 172.21.15.43:0/2308242808 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+23095 (secure 0 0 0) 0x7f379809d310 con 0x7f37a019bf70 2024-04-25T21:00:01.314 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T21:00:01.314 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":100,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T20:59:12.637437+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1916899701":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6800/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/3360697116":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/801305986":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/1350680357":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 msgr2=0x7f378c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 0x7f378c0a61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f379c009230 tx=0x7f379c0058d0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 msgr2=0x7f37a019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f379800e960 tx=0x7f379800ee20 comp rx=0 tx=0).stop 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 shutdown_connections 2024-04-25T21:00:01.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f378c0a3d20 0x7f378c0a61e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37a019bf70 0x7f37a019c420 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f37a0106190 0x7f37a0197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 --2- 172.21.15.43:0/2308242808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37a0101110 0x7f37a01976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.315+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 >> 172.21.15.43:0/2308242808 conn(0x7f37a0077fb0 msgr2=0x7f37a00fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.316+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 shutdown_connections 2024-04-25T21:00:01.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.316+0000 7f37a7acf640 1 -- 172.21.15.43:0/2308242808 wait complete. 2024-04-25T21:00:01.327 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T20:41:30.665993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T20:46:19.470974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T20:46:23.606562+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T21:00:01.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T21:00:01.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 -- 172.21.15.43:0/2798487645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081014a0 msgr2=0x7fea08106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 --2- 172.21.15.43:0/2798487645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081014a0 0x7fea08106bd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009900 tx=0x7fe9f802a410 comp rx=0 tx=0).stop 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 -- 172.21.15.43:0/2798487645 shutdown_connections 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 --2- 172.21.15.43:0/2798487645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081072b0 0x7fea0810eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 --2- 172.21.15.43:0/2798487645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081014a0 0x7fea08106bd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 --2- 172.21.15.43:0/2798487645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 0x7fea08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 -- 172.21.15.43:0/2798487645 >> 172.21.15.43:0/2798487645 conn(0x7fea080760e0 msgr2=0x7fea080764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 -- 172.21.15.43:0/2798487645 shutdown_connections 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.432+0000 7fea101d8640 1 -- 172.21.15.43:0/2798487645 wait complete. 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 Processor -- start 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 -- start start 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 0x7fea0819e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081986f0 0x7fea08198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea08112370 con 0x7fea081072b0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea081121f0 con 0x7fea081986f0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea101d8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fea081124f0 con 0x7fea08100af0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33802/0 (socket says 172.21.15.43:33802) 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 -- 172.21.15.43:0/746006245 learned_addr learned my addr 172.21.15.43:0/746006245 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0e775640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081986f0 0x7fea08198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0df74640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 0x7fea0819e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 -- 172.21.15.43:0/746006245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 msgr2=0x7fea0819e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 0x7fea0819e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 -- 172.21.15.43:0/746006245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081986f0 msgr2=0x7fea08198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081986f0 0x7fea08198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 -- 172.21.15.43:0/746006245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea081992f0 con 0x7fea081072b0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.433+0000 7fea0d773640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8005940 tx=0x7fe9f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.434+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f803f030 con 0x7fea081072b0 2024-04-25T21:00:01.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.434+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9f80318f0 con 0x7fea081072b0 2024-04-25T21:00:01.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.434+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea08199580 con 0x7fea081072b0 2024-04-25T21:00:01.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.434+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8035070 con 0x7fea081072b0 2024-04-25T21:00:01.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.434+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea081a56c0 con 0x7fea081072b0 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.435+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0806a010 con 0x7fea081072b0 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.437+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe9f8042030 con 0x7fea081072b0 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.437+0000 7fe9feffd640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 0x7fe9f40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.437+0000 7fea0df74640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 0x7fe9f40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.437+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7fe9f80f1000 con 0x7fea081072b0 2024-04-25T21:00:01.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.438+0000 7fea0df74640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 0x7fe9f40a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea04009b60 tx=0x7fea04005f90 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.441+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe9f80bd6a0 con 0x7fea081072b0 2024-04-25T21:00:01.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.630+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea0810a4d0 con 0x7fea081072b0 2024-04-25T21:00:01.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.631+0000 7fe9feffd640 1 -- 172.21.15.43:0/746006245 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7fe9f80bcfa0 con 0x7fea081072b0 2024-04-25T21:00:01.631 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-25T21:00:01.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 msgr2=0x7fe9f40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 0x7fe9f40a61e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea04009b60 tx=0x7fea04005f90 comp rx=0 tx=0).stop 2024-04-25T21:00:01.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 msgr2=0x7fea0819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8005940 tx=0x7fe9f80042f0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 shutdown_connections 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fe9f40a3d20 0x7fe9f40a61e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea081986f0 0x7fea08198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea081072b0 0x7fea0819eb70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 --2- 172.21.15.43:0/746006245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea08100af0 0x7fea0819e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 >> 172.21.15.43:0/746006245 conn(0x7fea080760e0 msgr2=0x7fea080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 shutdown_connections 2024-04-25T21:00:01.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.633+0000 7fea101d8640 1 -- 172.21.15.43:0/746006245 wait complete. 2024-04-25T21:00:01.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T21:00:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.748+0000 7fca6c34b640 1 -- 172.21.15.43:0/177560486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 msgr2=0x7fca6410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.748+0000 7fca6c34b640 1 --2- 172.21.15.43:0/177560486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6410bfc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fca54009900 tx=0x7fca5402a510 comp rx=0 tx=0).stop 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 -- 172.21.15.43:0/177560486 shutdown_connections 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 --2- 172.21.15.43:0/177560486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca6410c500 0x7fca6410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 --2- 172.21.15.43:0/177560486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6410bfc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 --2- 172.21.15.43:0/177560486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca641031c0 0x7fca641035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 -- 172.21.15.43:0/177560486 >> 172.21.15.43:0/177560486 conn(0x7fca64078000 msgr2=0x7fca64078410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 -- 172.21.15.43:0/177560486 shutdown_connections 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 -- 172.21.15.43:0/177560486 wait complete. 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 Processor -- start 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 -- start start 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 0x7fca6419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.749+0000 7fca6c34b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 0x7fca641986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca64112380 con 0x7fca64103ae0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fca64112200 con 0x7fca641031c0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca64112500 con 0x7fca6410c500 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33822/0 (socket says 172.21.15.43:33822) 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 -- 172.21.15.43:0/929192108 learned_addr learned my addr 172.21.15.43:0/929192108 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6a0e7640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 0x7fca6419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6a8e8640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 0x7fca641986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 -- 172.21.15.43:0/929192108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 msgr2=0x7fca641986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 0x7fca641986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 -- 172.21.15.43:0/929192108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 msgr2=0x7fca6419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 0x7fca6419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 -- 172.21.15.43:0/929192108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca64198f80 con 0x7fca64103ae0 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6a0e7640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 0x7fca6419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:01.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6a8e8640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 0x7fca641986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca698e6640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fca54006010 tx=0x7fca54003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5403f070 con 0x7fca64103ae0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca54031df0 con 0x7fca64103ae0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca54035030 con 0x7fca64103ae0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca64199210 con 0x7fca64103ae0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.750+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca641a5580 con 0x7fca64103ae0 2024-04-25T21:00:01.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.751+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca640698e0 con 0x7fca64103ae0 2024-04-25T21:00:01.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.752+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fca54042070 con 0x7fca64103ae0 2024-04-25T21:00:01.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.753+0000 7fca5b7fe640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 0x7fca500a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:01.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.753+0000 7fca6a0e7640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 0x7fca500a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:01.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.753+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7fca540f1630 con 0x7fca64103ae0 2024-04-25T21:00:01.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.754+0000 7fca6a0e7640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 0x7fca500a6260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60008040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:01.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.757+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fca540bdcd0 con 0x7fca64103ae0 2024-04-25T21:00:01.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.943+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fca641995a0 con 0x7fca64103ae0 2024-04-25T21:00:01.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.943+0000 7fca5b7fe640 1 -- 172.21.15.43:0/929192108 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) ==== 104+0+11 (secure 0 0 0) 0x7fca641995a0 con 0x7fca64103ae0 2024-04-25T21:00:01.944 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 msgr2=0x7fca500a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 0x7fca500a6260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60008040 comp rx=0 tx=0).stop 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 msgr2=0x7fca6419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fca54006010 tx=0x7fca54003d50 comp rx=0 tx=0).stop 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 shutdown_connections 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fca500a3da0 0x7fca500a6260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca6410c500 0x7fca641986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca64103ae0 0x7fca6419eb40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 --2- 172.21.15.43:0/929192108 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca641031c0 0x7fca6419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:01.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 >> 172.21.15.43:0/929192108 conn(0x7fca64078000 msgr2=0x7fca640fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:01.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 shutdown_connections 2024-04-25T21:00:01.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:01.945+0000 7fca6c34b640 1 -- 172.21.15.43:0/929192108 wait complete. 2024-04-25T21:00:01.955 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:01 smithi043 ceph-mon[29167]: pgmap v312: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:01.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:01 smithi043 ceph-mon[29167]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:01.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:01 smithi043 ceph-mon[29167]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:01.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2308242808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:01.956 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/746006245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T21:00:01.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T21:00:02.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 -- 172.21.15.43:0/550457671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 msgr2=0x7f0ecc10ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 --2- 172.21.15.43:0/550457671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc10ee40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009ca0 tx=0x7f0ec402a8c0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 -- 172.21.15.43:0/550457671 shutdown_connections 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 --2- 172.21.15.43:0/550457671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc10ee40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 --2- 172.21.15.43:0/550457671 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc06b1f0 0x7f0ecc106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 --2- 172.21.15.43:0/550457671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 0x7f0ecc06ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 -- 172.21.15.43:0/550457671 >> 172.21.15.43:0/550457671 conn(0x7f0ecc077eb0 msgr2=0x7f0ecc0782c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 -- 172.21.15.43:0/550457671 shutdown_connections 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.062+0000 7f0ed3730640 1 -- 172.21.15.43:0/550457671 wait complete. 2024-04-25T21:00:02.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 Processor -- start 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 -- start start 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 0x7f0ecc1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc19d010 0x7f0ecc19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc1123c0 con 0x7f0ecc107270 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc112240 con 0x7f0ecc19d010 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed3730640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc112540 con 0x7f0ecc06a840 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33834/0 (socket says 172.21.15.43:33834) 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 -- 172.21.15.43:0/2207212503 learned_addr learned my addr 172.21.15.43:0/2207212503 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed14cc640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 0x7f0ecc1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed1ccd640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc19d010 0x7f0ecc19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 -- 172.21.15.43:0/2207212503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 msgr2=0x7f0ecc1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 0x7f0ecc1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 -- 172.21.15.43:0/2207212503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc19d010 msgr2=0x7f0ecc19d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc19d010 0x7f0ecc19d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.063+0000 7f0ed0ccb640 1 -- 172.21.15.43:0/2207212503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc19db00 con 0x7f0ecc107270 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ed0ccb640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c970 tx=0x7f0ebc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc014070 con 0x7f0ecc107270 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ebc004440 con 0x7f0ecc107270 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc19ddf0 con 0x7f0ecc107270 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc003e40 con 0x7f0ecc107270 2024-04-25T21:00:02.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.064+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc1a5630 con 0x7f0ecc107270 2024-04-25T21:00:02.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.065+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc0691c0 con 0x7f0ecc107270 2024-04-25T21:00:02.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.066+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x7f0ecc107270 2024-04-25T21:00:02.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.067+0000 7f0ec27fc640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 0x7f0eb80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.067+0000 7f0ed14cc640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 0x7f0eb80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.067+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f0ebc0d0a50 con 0x7f0ecc107270 2024-04-25T21:00:02.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.067+0000 7f0ed14cc640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 0x7f0eb80a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009890 tx=0x7f0ec8008040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:02.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.070+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0ebc01e020 con 0x7f0ecc107270 2024-04-25T21:00:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:01 smithi195 ceph-mon[33250]: pgmap v312: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:01 smithi195 ceph-mon[33250]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:01 smithi195 ceph-mon[33250]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2308242808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/746006245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T21:00:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:01 smithi112 ceph-mon[32322]: pgmap v312: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:01 smithi112 ceph-mon[32322]: from='client.15810 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:01 smithi112 ceph-mon[32322]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T21:00:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2308242808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/746006245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T21:00:02.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.258+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ecc06b2c0 con 0x7f0ecc107270 2024-04-25T21:00:02.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.258+0000 7f0ec27fc640 1 -- 172.21.15.43:0/2207212503 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) ==== 100+0+11 (secure 0 0 0) 0x7f0ebc09d170 con 0x7f0ecc107270 2024-04-25T21:00:02.259 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 msgr2=0x7f0eb80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 0x7f0eb80a6260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009890 tx=0x7f0ec8008040 comp rx=0 tx=0).stop 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 msgr2=0x7f0ecc198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00c970 tx=0x7f0ebc00ce30 comp rx=0 tx=0).stop 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 shutdown_connections 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f0eb80a3da0 0x7f0eb80a6260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0ecc19d010 0x7f0ecc19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ecc107270 0x7f0ecc198ce0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 --2- 172.21.15.43:0/2207212503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ecc06a840 0x7f0ecc1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 >> 172.21.15.43:0/2207212503 conn(0x7f0ecc077eb0 msgr2=0x7f0ecc0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 shutdown_connections 2024-04-25T21:00:02.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.260+0000 7f0ed3730640 1 -- 172.21.15.43:0/2207212503 wait complete. 2024-04-25T21:00:02.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 -- 172.21.15.43:0/561555820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102bf0 msgr2=0x7f6d10106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 --2- 172.21.15.43:0/561555820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102bf0 0x7f6d10106ba0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009900 tx=0x7f6d0402a410 comp rx=0 tx=0).stop 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 -- 172.21.15.43:0/561555820 shutdown_connections 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 --2- 172.21.15.43:0/561555820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10107280 0x7f6d1010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 --2- 172.21.15.43:0/561555820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102bf0 0x7f6d10106ba0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 --2- 172.21.15.43:0/561555820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10102240 0x7f6d10102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 -- 172.21.15.43:0/561555820 >> 172.21.15.43:0/561555820 conn(0x7f6d100790e0 msgr2=0x7f6d100794f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 -- 172.21.15.43:0/561555820 shutdown_connections 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.372+0000 7f6d1604e640 1 -- 172.21.15.43:0/561555820 wait complete. 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 Processor -- start 2024-04-25T21:00:02.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 -- start start 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10107280 0x7f6d10074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 0x7f6d101a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10112350 con 0x7f6d10102240 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d101121d0 con 0x7f6d10107280 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d1604e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6d101124d0 con 0x7f6d10074cd0 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d0f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33852/0 (socket says 172.21.15.43:33852) 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d0f7fe640 1 -- 172.21.15.43:0/3223691192 learned_addr learned my addr 172.21.15.43:0/3223691192 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.373+0000 7f6d0effd640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10107280 0x7f6d10074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0ffff640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 0x7f6d101a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 -- 172.21.15.43:0/3223691192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 msgr2=0x7f6d101a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 0x7f6d101a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 -- 172.21.15.43:0/3223691192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10107280 msgr2=0x7f6d10074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10107280 0x7f6d10074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 -- 172.21.15.43:0/3223691192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101a7100 con 0x7f6d10102240 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0ffff640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 0x7f6d101a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0f7fe640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d950 tx=0x7f6d0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00017070 con 0x7f6d10102240 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d101a73f0 con 0x7f6d10102240 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6d00009c30 con 0x7f6d10102240 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000f6b0 con 0x7f6d10102240 2024-04-25T21:00:02.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.374+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101a7960 con 0x7f6d10102240 2024-04-25T21:00:02.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.375+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d100691c0 con 0x7f6d10102240 2024-04-25T21:00:02.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.376+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6d000109c0 con 0x7f6d10102240 2024-04-25T21:00:02.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.377+0000 7f6d0cff9640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 0x7f6cf80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:02.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.377+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8513+0+0 (secure 0 0 0) 0x7f6d000d03d0 con 0x7f6d10102240 2024-04-25T21:00:02.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.377+0000 7f6d0effd640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 0x7f6cf80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:02.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.378+0000 7f6d0effd640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 0x7f6cf80a6210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402aa00 tx=0x7f6d04000bc0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.382+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6d00009de0 con 0x7f6d10102240 2024-04-25T21:00:02.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.618+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f6d1010a4a0 con 0x7f6d10102240 2024-04-25T21:00:02.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.627+0000 7f6d0cff9640 1 -- 172.21.15.43:0/3223691192 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+746062 (secure 0 0 0) 0x7f6d0009ca70 con 0x7f6d10102240 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 25, 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: "active_gid": 24908, 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: "active_name": "x", 2024-04-25T21:00:02.637 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addrs": { 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6800", 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1773585199 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:6801", 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1773585199 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.638 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "active_addr": "172.21.15.43:6801/1773585199", 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "active_change": "2024-04-25T20:49:58.419572+0000", 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "available": true, 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "standbys": [ 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 24905, 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "y", 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T21:00:02.639 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.640 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.641 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.643 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.644 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.645 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.646 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.647 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.648 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.649 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.650 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T21:00:02.651 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T21:00:02.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T21:00:02.653 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.654 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.656 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:02.657 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:02.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.659 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T21:00:02.660 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.661 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:02.662 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.663 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.665 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.666 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.667 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.668 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.669 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T21:00:02.670 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:02.671 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T21:00:02.672 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.673 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.674 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.675 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.676 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.677 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.678 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.679 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T21:00:02.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.681 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.682 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.683 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.684 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.685 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.686 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.687 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.688 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.694 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.696 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T21:00:02.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T21:00:02.698 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T21:00:02.699 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T21:00:02.700 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T21:00:02.701 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.702 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.704 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.705 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.706 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.708 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.709 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.711 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.712 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.713 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.714 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.716 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.717 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.718 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.719 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.721 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.723 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.724 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.726 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.728 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.729 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T21:00:02.730 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.732 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.733 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.734 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.736 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.737 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.738 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.740 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.742 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T21:00:02.744 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.745 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.748 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.749 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.750 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.751 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.752 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.754 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.755 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.756 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.759 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.760 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T21:00:02.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T21:00:02.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T21:00:02.763 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T21:00:02.764 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T21:00:02.765 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T21:00:02.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T21:00:02.767 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T21:00:02.768 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T21:00:02.769 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.770 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T21:00:02.771 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.772 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T21:00:02.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T21:00:02.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T21:00:02.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T21:00:02.776 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T21:00:02.777 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T21:00:02.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.780 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.782 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.783 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.785 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.786 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:02.787 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.788 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.789 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.790 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.791 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.794 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.796 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.798 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.804 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.805 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T21:00:02.806 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.807 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.808 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.809 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.810 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.811 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.813 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.815 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.816 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.817 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:02.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T21:00:02.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.821 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.822 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.823 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.825 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T21:00:02.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.827 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.828 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T21:00:02.829 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.830 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.831 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.833 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.834 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.836 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.837 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.839 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.840 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.841 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.842 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.843 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.844 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.846 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.847 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.848 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.849 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.850 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.851 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.853 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.854 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.855 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.856 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.859 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.861 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.862 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.863 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.865 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.866 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.867 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.868 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.869 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.870 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T21:00:02.872 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T21:00:02.874 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.875 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.877 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.878 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.879 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.880 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.882 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.883 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.886 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.887 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.888 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T21:00:02.890 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.891 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.894 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.895 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.896 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.898 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.900 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.901 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.902 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.903 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.904 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.905 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.906 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.907 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.908 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.909 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.910 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.911 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.912 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.913 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.914 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.915 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.916 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.917 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.918 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.919 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.920 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.921 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.922 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T21:00:02.923 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:02.924 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.925 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.928 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.929 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.930 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.931 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.932 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.933 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.934 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.935 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:02.936 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.937 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.938 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:02.939 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.940 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.941 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.942 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.943 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.944 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.945 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.946 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.947 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.948 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.949 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.950 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.951 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.953 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.954 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.955 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.956 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.957 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.958 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.959 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.960 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.961 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.962 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.963 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.964 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.965 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.966 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.967 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.968 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.969 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.970 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.971 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.972 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T21:00:02.973 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T21:00:02.975 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.976 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.977 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.979 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.980 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.981 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.982 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.984 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.985 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.986 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.987 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.988 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.989 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.990 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.991 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.992 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.993 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.994 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.995 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.996 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:02.997 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:02.998 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:02.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.000 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.001 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.002 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.003 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.005 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.006 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.007 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.008 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.010 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.011 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.012 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.013 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.014 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.015 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.016 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.017 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.018 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.019 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T21:00:03.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T21:00:03.021 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T21:00:03.022 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.023 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.024 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.026 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.027 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.028 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.029 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.030 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.031 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.033 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.034 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.035 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.036 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.037 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.039 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.040 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.041 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.042 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.043 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.044 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.045 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.046 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.047 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.048 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.049 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.050 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.051 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T21:00:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.053 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T21:00:03.054 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.055 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "gid": 24911, 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "z", 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_features": 4540701547738038271, 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.056 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.057 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.058 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.059 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.060 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.062 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.063 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T21:00:03.064 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T21:00:03.065 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.066 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.068 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.069 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.071 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T21:00:03.072 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:03.073 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T21:00:03.074 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.075 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T21:00:03.076 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.077 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:03.078 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.079 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.080 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.081 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.082 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T21:00:03.083 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.084 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.085 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.086 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.087 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.088 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.089 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.090 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T21:00:03.091 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T21:00:03.092 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T21:00:03.093 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.094 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.095 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.096 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.097 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.098 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.099 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.100 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.101 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.102 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.103 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.104 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.105 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T21:00:03.106 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T21:00:03.107 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T21:00:03.108 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T21:00:03.109 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.110 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.111 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.112 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.113 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.114 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.115 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.116 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.117 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.118 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.119 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.120 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.121 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.122 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.123 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.124 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.125 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.126 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.127 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.128 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.129 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.130 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.131 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.132 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.133 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T21:00:03.134 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T21:00:03.135 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T21:00:03.136 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T21:00:03.137 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T21:00:03.138 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:03.139 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.140 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.141 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.142 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T21:00:03.143 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.144 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.145 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.146 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.147 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.148 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.149 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.150 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.151 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.152 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.153 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.154 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.155 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.156 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.157 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.158 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.159 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T21:00:03.160 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.161 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.162 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T21:00:03.163 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T21:00:03.164 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T21:00:03.165 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.166 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.167 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.168 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.169 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.170 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.171 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T21:00:03.172 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T21:00:03.173 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T21:00:03.174 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.175 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.176 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.177 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.178 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.179 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.180 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.181 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.182 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.183 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.184 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.185 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.186 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.187 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.188 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.189 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.190 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.191 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.193 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T21:00:03.194 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T21:00:03.195 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T21:00:03.196 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T21:00:03.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.198 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.199 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.200 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.202 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.203 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.204 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.205 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.207 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.208 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.209 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.210 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.211 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.212 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.213 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.214 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.215 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.216 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T21:00:03.217 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.218 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.219 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.220 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.221 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.222 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T21:00:03.223 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.224 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.225 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.227 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.228 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.229 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.230 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.231 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T21:00:03.232 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.234 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.235 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.236 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.237 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T21:00:03.238 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.239 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.240 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.241 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.242 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.243 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.244 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.245 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.246 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.247 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T21:00:03.248 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T21:00:03.249 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.250 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.251 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.252 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.253 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.254 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.255 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.256 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T21:00:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:03.258 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.259 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.260 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.261 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.262 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.263 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.264 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.265 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.266 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.267 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.268 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.269 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.270 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.271 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.272 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.273 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T21:00:03.274 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.275 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.276 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.277 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.278 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.279 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.280 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.281 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.282 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.283 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.284 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.285 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.286 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.287 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.288 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.289 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.290 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.291 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.292 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.293 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.294 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.295 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.296 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.297 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.298 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.299 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.300 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.301 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.302 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.303 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.304 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.305 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.306 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.307 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.308 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.309 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.310 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.311 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.312 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.314 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.315 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.316 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.317 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.318 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.319 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.321 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.322 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.323 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.324 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.325 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.327 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.328 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.329 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.330 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.331 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.332 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.333 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.334 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.335 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.336 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T21:00:03.337 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.338 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T21:00:03.339 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.340 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.341 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.342 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.343 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.344 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.345 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.346 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.347 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.348 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.349 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.350 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.351 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.352 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.353 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.354 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.355 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.356 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.358 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.359 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.360 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.361 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.362 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.363 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.364 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.365 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.366 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.367 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.368 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.369 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.370 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.371 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.372 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.373 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.374 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.375 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.376 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.377 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.378 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.379 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.380 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.381 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.382 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.383 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.384 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.385 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.386 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.387 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.388 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.389 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.390 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.391 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.393 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.394 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.395 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.396 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.397 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.398 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.399 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.400 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.400 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.400 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.401 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.401 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.402 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.403 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.404 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.405 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.406 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.407 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.408 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.409 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.410 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.411 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.412 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.413 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.414 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.416 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.417 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.419 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.420 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.422 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.423 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.425 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.426 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.427 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.428 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.429 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.430 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.431 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T21:00:03.432 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.433 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.434 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T21:00:03.437 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T21:00:03.438 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T21:00:03.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.441 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.442 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.448 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.449 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.450 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.451 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.452 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.453 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.455 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.456 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.457 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.458 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.459 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T21:00:03.460 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.461 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.462 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.463 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.464 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.465 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.466 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.467 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.468 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.469 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.470 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.471 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.472 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "modules": [ 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard", 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "iostat", 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "nfs", 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "restful", 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_schedule" 2024-04-25T21:00:03.473 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "available_modules": [ 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "alerts", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.474 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.475 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.476 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.477 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.478 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.479 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_destination": { 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_destination", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email address to send alerts to", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.480 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_from_name": { 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_from_name", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "Ceph", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Email From: name", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.481 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_host": { 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_host", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP server", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.482 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_password": { 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_password", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Password to authenticate with", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.483 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_port": { 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_port", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "465", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP port", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_sender": { 2024-04-25T21:00:03.484 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_sender", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SMTP envelope sender", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_ssl": { 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_ssl", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.485 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "smtp_user": { 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "smtp_user", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.486 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "User to authenticate as", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "balancer", 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.487 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "active": { 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "active", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.488 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_time": { 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_time", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0000", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "begin_weekday": { 2024-04-25T21:00:03.489 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "begin_weekday", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_max_iterations": { 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_max_iterations", 2024-04-25T21:00:03.490 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "25", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "250", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_metrics": { 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_metrics", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.491 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_compat_step": { 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crush_compat_step", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.492 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.5", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0.001", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "0.999", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "aggressiveness of optimization", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "end_time": { 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_time", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.493 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2359", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "end_weekday": { 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "end_weekday", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.494 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "0", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "6", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.495 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.496 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.497 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.498 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.499 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min_score": { 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_score", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.500 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "upmap", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-compat", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "none", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "read", 2024-04-25T21:00:03.501 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap-read" 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Balancer mode", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ids": { 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_ids", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.503 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_deviation": { 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_deviation", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.504 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "upmap_max_optimizations": { 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "upmap_max_optimizations", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.505 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_down_multiplier": { 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_down_multiplier", 2024-04-25T21:00:03.506 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_refresh_rate": { 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_refresh_rate", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.507 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "20", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "agent_starting_port": { 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "agent_starting_port", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4721", 2024-04-25T21:00:03.508 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_ptrace": { 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_ptrace", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.509 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_interval": { 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_interval", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.510 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "autotune_memory_target_ratio": { 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0.7", 2024-04-25T21:00:03.511 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_log_destination": { 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cephadm_log_destination", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.512 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "file", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "file,syslog", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "syslog" 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "cgroups_split": { 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cgroups_split", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.513 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "config_checks_enabled": { 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_checks_enabled", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.514 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "config_dashboard": { 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_dashboard", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.515 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_alertmanager": { 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_alertmanager", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.516 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_base": { 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_base", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.517 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Container image name, without the tag", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_elasticsearch": { 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_elasticsearch", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.518 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "elasticsearch container image", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_grafana": { 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_grafana", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.519 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_haproxy": { 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_haproxy", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.520 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "HAproxy container image", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_agent": { 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_agent", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger agent container image", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.521 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_collector": { 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_collector", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger collector container image", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.522 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_jaeger_query": { 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_jaeger_query", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Jaeger query container image", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.523 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_keepalived": { 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_keepalived", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Keepalived container image", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.524 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_loki": { 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_loki", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Loki container image", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_node_exporter": { 2024-04-25T21:00:03.525 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_node_exporter", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_nvmeof": { 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_nvmeof", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.526 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Nvme-of container image", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_prometheus": { 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_prometheus", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.527 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Prometheus container image", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_promtail": { 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_promtail", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T21:00:03.528 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Promtail container image", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_samba": { 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_samba", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.529 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Samba/SMB container image", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image_snmp_gateway": { 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_image_snmp_gateway", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.530 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "SNMP Gateway container image", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "container_init": { 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "container_init", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.531 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "daemon_cache_timeout": { 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "daemon_cache_timeout", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.532 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_cephadm_command_timeout": { 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "900", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.533 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "default_registry": { 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "default_registry", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "docker.io", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.534 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "device_cache_timeout": { 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_cache_timeout", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1800", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache device inventory", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "device_enhanced_scan": { 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_enhanced_scan", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "facts_cache_timeout": { 2024-04-25T21:00:03.536 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "facts_cache_timeout", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "seconds to cache host facts data", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "grafana_dashboards_path": { 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "grafana_dashboards_path", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.537 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "host_check_interval": { 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "host_check_interval", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.538 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to perform a host check", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "hw_monitoring": { 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hw_monitoring", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.539 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "inventory_list_all": { 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "inventory_list_all", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.540 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.541 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "log_refresh_metadata": { 2024-04-25T21:00:03.542 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_refresh_metadata", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.543 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.544 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.545 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T21:00:03.546 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.547 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "*", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "max_count_per_host": { 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_count_per_host", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.548 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of daemons per service per host", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd_draining_count": { 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_osd_draining_count", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.549 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "migration_current": { 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "migration_current", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.550 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "internal - do not modify", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "mode": { 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mode", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "root", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.551 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm-package", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "root" 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "oob_default_addr": { 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "oob_default_addr", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "169.254.1.1", 2024-04-25T21:00:03.552 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "prometheus_alerts_path": { 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus_alerts_path", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.553 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_insecure": { 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_insecure", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.554 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_password": { 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_password", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.555 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_url": { 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_url", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.556 INFO:teuthology.orchestra.run.smithi043.stdout: "registry_username": { 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "registry_username", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "secure_monitoring_stack": { 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "secure_monitoring_stack", 2024-04-25T21:00:03.557 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "service_discovery_port": { 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "service_discovery_port", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.558 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8765", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "cephadm service discovery port", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "ssh_config_file": { 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssh_config_file", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.559 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "use_agent": { 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_agent", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.560 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "use_repo_digest": { 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "use_repo_digest", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.561 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_failed_host_check": { 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_failed_host_check", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.562 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_daemons": { 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_daemons", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.563 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_on_stray_hosts": { 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_on_stray_hosts", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.564 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crash", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.565 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.566 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.567 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.568 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "retain_interval": { 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retain_interval", 2024-04-25T21:00:03.569 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "31536000", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_recent_interval": { 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_recent_interval", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.570 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1209600", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.571 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dashboard", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.572 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.573 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.574 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_ENABLED": { 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T21:00:03.575 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.576 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.577 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.578 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.580 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.581 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.582 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.583 INFO:teuthology.orchestra.run.smithi043.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T21:00:03.584 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.585 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_URL": { 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_URL", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.586 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.587 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.588 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.589 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.590 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.591 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "[]", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.592 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "{}", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.593 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.594 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.595 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T21:00:03.596 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.597 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.598 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.599 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.600 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.601 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.602 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.603 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T21:00:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T21:00:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.604 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.605 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.606 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "45", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.607 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.608 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "admin", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T21:00:03.609 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T21:00:03.610 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.611 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.612 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.613 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T21:00:03.614 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "cross_origin_url": { 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cross_origin_url", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.615 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "crt_file": { 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "crt_file", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.616 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "debug": { 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "debug", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.617 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Enable/disable debug options", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "jwt_token_ttl": { 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "jwt_token_ttl", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "28800", 2024-04-25T21:00:03.618 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.619 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.620 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.623 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.624 INFO:teuthology.orchestra.run.smithi043.stdout: "motd": { 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "motd", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "The message of the day", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.625 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect_resolve_ip_addr": { 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8080", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.628 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl_server_port": { 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl_server_port", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8443", 2024-04-25T21:00:03.629 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "redirect", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.630 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "redirect" 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:03.631 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "url_prefix": { 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url_prefix", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.632 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_monitoring": { 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_monitoring", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.633 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "monitor device health metrics", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.634 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.635 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.636 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.637 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.638 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "mark_out_threshold": { 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mark_out_threshold", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "2419200", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.639 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": { 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pool_name", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "device_health_metrics", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T21:00:03.640 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "retention_period": { 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "retention_period", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15552000", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long to retain device health metrics", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_frequency": { 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_frequency", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:03.642 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "self_heal": { 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "self_heal", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.643 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T21:00:03.644 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "warn_threshold": { 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "warn_threshold", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7257600", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.645 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "diskprediction_local", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.646 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.647 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.648 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.649 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.650 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "predict_interval": { 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predict_interval", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "86400", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.651 INFO:teuthology.orchestra.run.smithi043.stdout: "predictor_model": { 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "predictor_model", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "prophetstor", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.652 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "600", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.653 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "influx", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": false, 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "influxdb python module not found", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "batch_size": { 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "batch_size", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5000", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.654 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "database": { 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "database", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "ceph", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.655 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "hostname": { 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "hostname", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server hostname", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.656 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "30", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "5", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.657 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.658 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.659 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.660 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.661 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "password": { 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "password", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.662 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "password of InfluxDB server user", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "port": { 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "port", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "8086", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.663 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "InfluxDB server port", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "ssl": { 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ssl", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "false", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.664 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "threads": { 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threads", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "32", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T21:00:03.665 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "username": { 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "username", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "username of InfluxDB server user", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.666 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "verify_ssl": { 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "verify_ssl", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "true", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.667 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "insights", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.668 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.669 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.670 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.671 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.672 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "iostat", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.673 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.674 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.675 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.676 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.677 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "k8sevents", 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.678 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_event_retention_days": { 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "ceph_event_retention_days", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "7", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.679 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "config_check_secs": { 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "config_check_secs", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "10", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.680 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.681 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.682 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.683 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.684 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.685 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "localpool", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "failure_domain": { 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "failure_domain", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "host", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "failure domain for any created local pool", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T21:00:03.686 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.687 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.688 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.689 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.690 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": { 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "min_size", 2024-04-25T21:00:03.691 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default min_size for any created local pool", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "num_rep": { 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "num_rep", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.692 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default replica count for any created local pool", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": { 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_num", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "128", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.693 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "prefix": { 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prefix", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.694 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "name prefix for any created local pool", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "subtree": { 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "subtree", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "rack", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T21:00:03.695 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mds_autoscaler", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.696 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.697 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.698 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.699 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.700 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirroring", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.701 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.702 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.703 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.704 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.705 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "nfs", 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.706 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.707 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.708 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.709 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.710 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.711 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "fail_fs": { 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "fail_fs", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T21:00:03.712 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.714 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.715 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.717 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator": { 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "orchestrator", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "rook", 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: "test_orchestrator" 2024-04-25T21:00:03.718 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Orchestrator backend", 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_perf_query", 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.719 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.720 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.721 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.722 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.723 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.724 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "osd_support", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.725 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.727 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.728 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.729 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "pg_autoscaler", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.730 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.731 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.732 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.733 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.734 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.735 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "threshold": { 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "threshold", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "3.0", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1.0", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "scaling threshold", 2024-04-25T21:00:03.736 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "progress", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_pg_recovery_event": { 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_pg_recovery_event", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.737 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.738 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.739 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.740 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.741 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.742 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.743 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max_completed_events": { 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_completed_events", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "50", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.744 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "number of past completed events to remember", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "sleep_interval": { 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "sleep_interval", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "5", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.745 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "how long the module is going to sleep", 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "prometheus", 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "cache": { 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "cache", 2024-04-25T21:00:03.746 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "exclude_perf_counters": { 2024-04-25T21:00:03.747 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "exclude_perf_counters", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.748 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.749 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.750 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.751 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.752 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.753 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools": { 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.754 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.755 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "300", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "scrape_interval": { 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "scrape_interval", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15.0", 2024-04-25T21:00:03.756 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "::", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.757 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "9283", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "stale_cache_strategy": { 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stale_cache_strategy", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "log", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_behaviour": { 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_behaviour", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "default", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "default", 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: "error" 2024-04-25T21:00:03.760 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "standby_error_status_code": { 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "standby_error_status_code", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "500", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "400", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "599", 2024-04-25T21:00:03.761 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.762 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.763 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.764 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.765 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.766 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_snap_create": { 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_snap_create", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.767 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "mirror_snapshot_schedule": { 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.768 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "trash_purge_schedule": { 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "trash_purge_schedule", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.769 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "restful", 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_auth": { 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enable_auth", 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.770 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "key_file": { 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "key_file", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.772 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.773 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.774 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.775 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.776 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "server_addr": { 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_addr", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.777 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "server_port": { 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "server_port", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.778 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rgw", 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.779 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.781 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.782 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.783 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rook", 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.784 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.785 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.786 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.787 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.788 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "storage_class": { 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "storage_class", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.789 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "local", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "selftest", 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.790 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.792 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.793 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.794 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "roption1": { 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption1", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.795 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "roption2": { 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "roption2", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "xyz", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.796 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption1": { 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption1", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.797 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption2": { 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption2", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.798 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption3": { 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption3", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "float", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.799 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption4": { 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption4", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.800 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption5": { 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption5", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.801 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption6": { 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption6", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "rwoption7": { 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rwoption7", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "1", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "42", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "testkey": { 2024-04-25T21:00:03.803 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testkey", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "testlkey": { 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testlkey", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.804 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "testnewline": { 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "testnewline", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.805 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T21:00:03.806 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.807 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.807 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_m_granularity": { 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "allow_m_granularity", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T21:00:03.809 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "dump_on_update": { 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "dump_on_update", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "dump database to debug log on update", 2024-04-25T21:00:03.810 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.811 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.812 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.813 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.814 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "stats", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.815 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.816 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.817 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.819 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "status", 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.820 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.821 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.822 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.823 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.824 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telegraf", 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.825 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "address": { 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "address", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.826 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "15", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.827 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.828 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.830 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.831 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.832 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "telemetry", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_basic": { 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_basic", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.833 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_crash": { 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_crash", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.834 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_device": { 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_device", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.835 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_ident": { 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_ident", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.836 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "channel_perf": { 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "channel_perf", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.837 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "contact": { 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "contact", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.838 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "description": { 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "description", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.839 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "device_url": { 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "device_url", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.840 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": { 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "enabled", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.841 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.842 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "24", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "8", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "last_opt_revision": { 2024-04-25T21:00:03.843 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "last_opt_revision", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "1", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.844 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard": { 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard", 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.845 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.846 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "leaderboard_description": { 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "leaderboard_description", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.847 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.849 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.850 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.851 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.852 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.853 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.855 INFO:teuthology.orchestra.run.smithi043.stdout: "organization": { 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "organization", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.856 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "proxy": { 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "proxy", 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.857 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.858 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "url": { 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "url", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.859 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "test_orchestrator", 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.860 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.861 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.862 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.863 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.864 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.865 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.866 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.867 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.868 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.870 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.871 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.873 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.874 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.875 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.876 INFO:teuthology.orchestra.run.smithi043.stdout: "max_concurrent_clones": { 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "max_concurrent_clones", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "4", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T21:00:03.877 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "periodic_async_work": { 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "periodic_async_work", 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.878 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Periodically check for async work", 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.879 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_delay": { 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_delay", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "0", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T21:00:03.880 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "snapshot_clone_no_wait": { 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "True", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T21:00:03.881 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix", 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "can_run": true, 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "error_string": "", 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "module_options": { 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "discovery_interval": { 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "discovery_interval", 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "uint", 2024-04-25T21:00:03.882 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "100", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "identifier": { 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "identifier", 2024-04-25T21:00:03.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "interval": { 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "interval", 2024-04-25T21:00:03.884 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "secs", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "60", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "log_level": { 2024-04-25T21:00:03.885 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_level", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.886 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster": { 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.887 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_cluster_level": { 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_cluster_level", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "info", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.888 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [ 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "critical", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "debug", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "error", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "info", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "warning" 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": { 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "log_to_file", 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "bool", 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "False", 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.890 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_host": { 2024-04-25T21:00:03.891 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_host", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.892 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_port": { 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_port", 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "int", 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "10051", 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.893 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "zabbix_sender": { 2024-04-25T21:00:03.894 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "zabbix_sender", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "str", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "level": "advanced", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 0, 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "min": "", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "max": "", 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "enum_allowed": [], 2024-04-25T21:00:03.895 INFO:teuthology.orchestra.run.smithi043.stdout: "desc": "", 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: "long_desc": "", 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: "see_also": [] 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: "services": { 2024-04-25T21:00:03.896 INFO:teuthology.orchestra.run.smithi043.stdout: "dashboard": "https://172.21.15.43:8443/" 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "always_on_modules": { 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "octopus": [ 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T21:00:03.897 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "pacific": [ 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T21:00:03.898 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "quincy": [ 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T21:00:03.899 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "reef": [ 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T21:00:03.900 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "squid": [ 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "balancer", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "crash", 2024-04-25T21:00:03.901 INFO:teuthology.orchestra.run.smithi043.stdout: "devicehealth", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "orchestrator", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscaler", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "progress", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_support", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "status", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "telemetry", 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: "volumes" 2024-04-25T21:00:03.902 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: "last_failure_osd_epoch": 92, 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: "active_clients": [ 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "devicehealth", 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.903 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 4018843590 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "libcephsqlite", 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1595213319 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.905 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "rbd_support", 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 3224453162 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.906 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 2312942675 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "snap_schedule", 2024-04-25T21:00:03.907 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 1598636753 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.908 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "volumes", 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.43:0", 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 163397984 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-25T21:00:03.909 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T21:00:03.911 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:02 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/929192108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.911 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:02 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2207212503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.911 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:02 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3223691192' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T21:00:03.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:02 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/929192108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:02 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2207212503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.912 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:02 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3223691192' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 msgr2=0x7f6cf80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 0x7f6cf80a6210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402aa00 tx=0x7f6d04000bc0 comp rx=0 tx=0).stop 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 msgr2=0x7f6d10074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d950 tx=0x7f6d0000de10 comp rx=0 tx=0).stop 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 shutdown_connections 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f6cf80a3d50 0x7f6cf80a6210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d10074cd0 0x7f6d101a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:03.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d10107280 0x7f6d10074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:03.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 --2- 172.21.15.43:0/3223691192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d10102240 0x7f6d10074250 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:03.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 >> 172.21.15.43:0/3223691192 conn(0x7f6d100790e0 msgr2=0x7f6d10100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:03.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 shutdown_connections 2024-04-25T21:00:03.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:02.632+0000 7f6d1604e640 1 -- 172.21.15.43:0/3223691192 wait complete. 2024-04-25T21:00:03.920 DEBUG:tasks.check_counter:Getting stats from a 2024-04-25T21:00:03.920 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-25T21:00:03.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:02 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/929192108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:02 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2207212503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T21:00:03.921 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:02 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3223691192' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T21:00:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:03 smithi195 ceph-mon[33250]: pgmap v313: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:03 smithi112 ceph-mon[32322]: pgmap v313: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:04.181 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:04.294 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:03 smithi043 ceph-mon[29167]: pgmap v313: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:05.914 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:05 smithi043 ceph-mon[29167]: pgmap v314: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 34 op/s 2024-04-25T21:00:06.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:05 smithi195 ceph-mon[33250]: pgmap v314: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 34 op/s 2024-04-25T21:00:06.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:05 smithi112 ceph-mon[32322]: pgmap v314: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 34 op/s 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1586, 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1588, 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 4662777, 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 504349, 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-04-25T21:00:06.193 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.158050571, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.053092948, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.040683695, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.049232366, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1586, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.057477522, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000036240 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.194 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 714, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 882, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 5694251, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 687516, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.081389453, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.031381187, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.021303244, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.019647237, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 880, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.042774021, 2024-04-25T21:00:06.195 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000048606 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 462304 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 332, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 290, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 5900530, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 156812, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T21:00:06.196 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.052549605, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.016226394, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.040345002, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.005639592, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 289, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.013415766, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000046421 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.197 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1693344, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 140912 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3928, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.107457330, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000027356 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.198 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.199 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 2287, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 2287, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 2287, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 1, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-04-25T21:00:06.200 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 1, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:06.201 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:06.202 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-04-25T21:00:06.203 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-04-25T21:00:06.204 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 6845, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 10, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 2, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 4194304, 2024-04-25T21:00:06.205 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 18092279, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 18091680, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 6845 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 185, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 2370, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 2185, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 35, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 200, 2024-04-25T21:00:06.206 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 165, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 2287, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 3950, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 1663, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 56172, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215416 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-04-25T21:00:06.207 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-04-25T21:00:06.208 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.209 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.210 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.211 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.213 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.214 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.215 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-04-25T21:00:06.216 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.217 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 2, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 4, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 2, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 3, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 2444, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:06.218 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:06.219 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:06.220 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 214585, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 264, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:06.221 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 167, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 2119890, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 18485, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T21:00:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 2344, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 21, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 3, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 2344, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2344, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.652977754, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000705195 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-04-25T21:00:06.223 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2344, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2345 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 2344, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 2344, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 1491, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 851, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-04-25T21:00:06.224 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 1, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:06.225 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-04-25T21:00:06.226 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 100, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 11, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 7, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 7, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:06.227 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:06.228 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 2628, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 16003719, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 2628, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2628, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 16003719, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.229 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2344, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 13898506, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2344, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 13898506, 2024-04-25T21:00:06.230 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2344, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 2344, 2024-04-25T21:00:06.231 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2344, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 2344, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:06.232 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x55666d6726e0": { 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:06.233 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:06.234 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:07.053 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:07.053 DEBUG:tasks.check_counter:Getting stats from d 2024-04-25T21:00:07.053 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-25T21:00:07.309 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:08.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:07 smithi043 ceph-mon[29167]: pgmap v315: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-25T21:00:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:07 smithi195 ceph-mon[33250]: pgmap v315: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-25T21:00:08.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:07 smithi112 ceph-mon[32322]: pgmap v315: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-25T21:00:09.008 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:08 smithi043 ceph-mon[29167]: osdmap e101: 12 total, 12 up, 12 in 2024-04-25T21:00:09.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:08 smithi195 ceph-mon[33250]: osdmap e101: 12 total, 12 up, 12 in 2024-04-25T21:00:09.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:08 smithi112 ceph-mon[32322]: osdmap e101: 12 total, 12 up, 12 in 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 4, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 4, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 2992, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 448, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001527843, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000037685, 2024-04-25T21:00:09.138 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000542847, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000759121, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000253040 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:09.139 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 176, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 320, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 187056, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.016062886, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.011647289, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.001702096, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 173, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.015029423, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000086875 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:09.140 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 187056 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 241, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 231, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1456240, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 142144, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.044276311, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.015369911, 2024-04-25T21:00:09.141 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.031376664, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004895398, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 230, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.011897171, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000051726 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1456240, 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 142144 2024-04-25T21:00:09.142 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:09.143 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:09.144 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 148714, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 30, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:09.145 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T21:00:09.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 243, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1422245, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 243, 2024-04-25T21:00:09.147 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 243, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1422245, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:09.148 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-25T21:00:09.972 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-25T21:00:09.973 DEBUG:tasks.check_counter:Getting stats from g 2024-04-25T21:00:09.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-25T21:00:09.997 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:09 smithi043 ceph-mon[29167]: pgmap v317: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:10.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:09 smithi195 ceph-mon[33250]: pgmap v317: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:10.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:09 smithi112 ceph-mon[32322]: pgmap v317: 97 pgs: 97 active+clean; 76 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:10.228 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:12.007 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:11 smithi043 ceph-mon[29167]: pgmap v318: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 809, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 809, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 273417, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 256439, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 6, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 2, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.092486159, 2024-04-25T21:00:12.008 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.038886265, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.019893675, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.023708020, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 808, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.042934127, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000053136 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-25T21:00:12.009 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 1819, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 1777, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 12763911, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 630237, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.143916295, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.041422197, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.068011166, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.037536210, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 1776, 2024-04-25T21:00:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.054389819, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000030624 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1694752, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 142368 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 5, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 177, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1668, 2024-04-25T21:00:12.011 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 464789, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 7, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.013566881, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.008634171, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.002759423, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000074675, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 174, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.015685648, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000090147 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.012 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 463824 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 1, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-MDSRank": { 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 3851, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.098631398, 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000025611 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "queue_len": 0, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "complete_latency": { 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": { 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "request": 0, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "reply": 0, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "reply_latency": { 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.014 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_reply": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "forward": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_commit": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_split": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_merge": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes": 1707, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_top": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_bottom": 1707, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pin_tail": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_pinned": 1707, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_expired": 0, 2024-04-25T21:00:12.015 INFO:teuthology.orchestra.run.smithi043.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "subtrees": 1, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_hit": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_forward": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_discover": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "traverse_lock": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "load_cent": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "q": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "exported": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "exported_inodes": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "imported": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "imported_inodes": 0, 2024-04-25T21:00:12.016 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rfiles": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rbytes": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "root_rsnaps": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_inode_file_caps": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T21:00:12.017 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_grant": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_caps_dirty": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_cap_release": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "process_request_cap_release": 0 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache": { 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_update_receipt": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_try_discover": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_send_discover": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "dir_handle_discover": 0, 2024-04-25T21:00:12.018 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_created": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_enqueued": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "strays_migrated": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_started": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_completed": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_path": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_quiesce_inode": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_exportdir": 0, 2024-04-25T21:00:12.019 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_flush": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "ireq_inodestats": 0 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log": { 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evlrg": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evadd": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evex": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evtrm": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "ev": 5265, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evexg": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "evexd": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "segadd": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "segex": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "segtrm": 0, 2024-04-25T21:00:12.020 INFO:teuthology.orchestra.run.smithi043.stdout: "seg": 7, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "segmjr": 2, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "segexg": 0, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "segexd": 0, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "expos": 4194304, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "wrpos": 14866387, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "rdpos": 14865788, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "jlat": { 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "replayed": 5265 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mem": { 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "ino": 32, 2024-04-25T21:00:12.021 INFO:teuthology.orchestra.run.smithi043.stdout: "ino+": 1646, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "ino-": 1614, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dir": 13, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dir+": 130, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dir-": 117, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dn": 1707, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dn+": 2777, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dn-": 1070, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "cap": 0, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "cap+": 0, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "cap-": 0, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "rss": 52720, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "heap": 215416 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_server": { 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_client_request": 0, 2024-04-25T21:00:12.022 INFO:teuthology.orchestra.run.smithi043.stdout: "dispatch_server_request": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_request": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_client_session": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "handle_peer_request": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "req_create_latency": { 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getattr_latency": { 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.023 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "req_link_latency": { 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookup_latency": { 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.024 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupino_latency": { 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupname_latency": { 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.025 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "req_lssnap_latency": { 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.026 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mkdir_latency": { 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mknod_latency": { 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "req_mksnap_latency": { 2024-04-25T21:00:12.027 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "req_open_latency": { 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "req_readdir_latency": { 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rename_latency": { 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.028 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmdir_latency": { 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.029 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setattr_latency": { 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.030 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setlayout_latency": { 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.031 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "req_setxattr_latency": { 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "req_symlink_latency": { 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "req_unlink_latency": { 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.032 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessions": { 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "session_count": 2, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "session_add": 5, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "session_remove": 3, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_open": 4, 2024-04-25T21:00:12.033 INFO:teuthology.orchestra.run.smithi043.stdout: "sessions_stale": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "total_load": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "average_load": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "avg_session_uptime": 3063, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:12.034 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:12.035 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 199314, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 85, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:12.036 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 8152, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 170, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 1307223, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 9170, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:12.037 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter": { 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_active": 0, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_laggy": 0, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send": 2342, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_send_bytes": 21, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_resend": 3, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_reply": 2342, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "op_latency": { 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2342, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 1.913974215, 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000817239 2024-04-25T21:00:12.038 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op_inflight": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "oplen_avg": { 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 2342, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 2343 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op": 2342, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op_r": 2342, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op_w": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op_rmw": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "op_pg": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_stat": 1500, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_create": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_read": 840, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_write": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writefull": 0, 2024-04-25T21:00:12.039 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_writesame": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_append": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_zero": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_truncate": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_delete": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_mapext": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_getxattr": 1, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_setxattr": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_call": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_watch": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_notify": 0, 2024-04-25T21:00:12.040 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "osdop_other": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_active": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_send": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_resend": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ping": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_active": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_send": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolop_resend": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_active": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_send": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "poolstat_resend": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_active": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_send": 0, 2024-04-25T21:00:12.041 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_resend": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "command_active": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "command_send": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "command_resend": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "map_epoch": 101, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "map_full": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "map_inc": 12, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_sessions": 6, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_open": 6, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_session_close": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_laggy": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_wr": 0, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_rd": 2, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_del": 0 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.042 INFO:teuthology.orchestra.run.smithi043.stdout: "oft": { 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_objs": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_updates": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "omap_total_removes": 0 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "osd-slow-ops": { 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "slow_ops_count": 0 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "purge_queue": { 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executing_high_water": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed_ops": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_executed": 0, 2024-04-25T21:00:12.043 INFO:teuthology.orchestra.run.smithi043.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 2629, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 12784912, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 2629, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2629, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 12784912, 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:12.044 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2342, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 10672088, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2342, 2024-04-25T21:00:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 10672088, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 1024, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 2342, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 2342, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 2342, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 2342, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:12.047 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-write_buf_throttle-0x5643212186e0": { 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 3758096384, 2024-04-25T21:00:12.048 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:12.049 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T21:00:12.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:11 smithi195 ceph-mon[33250]: pgmap v318: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:12.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:11 smithi112 ceph-mon[32322]: pgmap v318: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:12.813 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:12.813 DEBUG:tasks.check_counter:Getting stats from j 2024-04-25T21:00:12.813 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:12 smithi043 ceph-mon[29167]: osdmap e102: 12 total, 12 up, 12 in 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:12 smithi195 ceph-mon[33250]: osdmap e102: 12 total, 12 up, 12 in 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:13.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:12 smithi112 ceph-mon[32322]: osdmap e102: 12 total, 12 up, 12 in 2024-04-25T21:00:13.785 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:14.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:13 smithi195 ceph-mon[33250]: pgmap v319: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:14.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:13 smithi112 ceph-mon[32322]: pgmap v319: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:14.168 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:13 smithi043 ceph-mon[29167]: pgmap v319: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 53 KiB/s wr, 35 op/s 2024-04-25T21:00:15.214 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.215 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.216 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:15 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.341 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.342 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:15 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.343 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:15 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:15.491 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-25T21:00:15.491 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:15.491 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 0, 2024-04-25T21:00:15.491 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 2, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 0, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 0, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 4, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 0, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.001205177, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.000203099, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:15.492 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 2, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 179, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 320, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 187584, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 5, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:15.493 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.015284031, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.010677925, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.001825126, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 176, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.017277316, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000098166 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T21:00:15.494 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 187584 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_messages": 248, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages": 236, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_bytes": 1460048, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_bytes": 144512, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_created_connections": 2, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_active_connections": 1, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_total_time": 0.047464475, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_send_time": 0.015454576, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_recv_time": 0.034681660, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_running_fast_dispatch_time": 0.004818938, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 236, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.012341177, 2024-04-25T21:00:15.495 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000052293 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_recv_encrypted_bytes": 1460048, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "msgr_send_encrypted_bytes": 144512 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "cct": { 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "total_workers": 0, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "unhealthy_workers": 0 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.496 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool": { 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:15.497 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:15.498 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_bytes": 148714, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_anon_items": 30, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:15.499 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_bytes": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_items": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "pgmap_items": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_bytes": 928, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_co_items": 2, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_1_items": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "unittest_2_items": 0 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "val": 0, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max": 104857600, 2024-04-25T21:00:15.500 INFO:teuthology.orchestra.run.smithi043.stdout: "get_started": 0, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "get": 246, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "get_sum": 1422635, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "get_or_fail_success": 246, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "take": 0, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "take_sum": 0, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "put": 246, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "put_sum": 1422635, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "wait": { 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "avgcount": 0, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "sum": 0.000000000, 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: "avgtime": 0.000000000 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-25T21:00:15.501 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-25T21:00:16.193 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-25T21:00:16.193 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-25T21:00:16.193 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-25T21:00:16.193 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-25T21:00:16.194 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-25T21:00:16.194 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-25T21:00:16.194 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-25T21:00:16.194 DEBUG:tasks.check_counter:Getting stats from b 2024-04-25T21:00:16.194 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-25T21:00:16.443 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T21:00:16.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:16 smithi043 ceph-mon[29167]: pgmap v321: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T21:00:16.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:16 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T21:00:16.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:16 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T21:00:16.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:16 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T21:00:16.545 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:16 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T21:00:16.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:16 smithi112 ceph-mon[32322]: pgmap v321: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T21:00:16.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:16 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T21:00:16.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:16 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T21:00:16.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:16 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T21:00:16.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:16 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T21:00:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:16 smithi195 ceph-mon[33250]: pgmap v321: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-25T21:00:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:16 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi112 to 176.2M 2024-04-25T21:00:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:16 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi112 to 184763084: error parsing value: Value '184763084' is below minimum 939524096 2024-04-25T21:00:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:16 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi195 to 176.2M 2024-04-25T21:00:16.591 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:16 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi195 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T21:00:17.738 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.738 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: pgmap v322: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T21:00:17.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T21:00:17.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T21:00:17.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T21:00:17.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:17 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: pgmap v322: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T21:00:17.794 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T21:00:17.795 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:17 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: pgmap v322: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 14 op/s 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T21:00:17.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: Adjusting osd_memory_target on smithi043 to 177.2M 2024-04-25T21:00:17.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: Unable to set osd_memory_target on smithi043 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-04-25T21:00:17.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T21:00:17.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T21:00:17.842 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:17 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 36130, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 63983, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 14646123, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 53696997, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 16, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:18.368 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 2.430773765, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 1.166811567, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 1.626398599, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.193339989, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 63984, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 6.105375965, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000095420 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 81486, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011857998, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000145 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 8434288, 2024-04-25T21:00:18.369 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 25472960 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 14212, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 13505, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 6580827, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 21629573, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 10, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 7, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.926359385, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.363883588, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.370502292, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.222685494, 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:18.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13505, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 7.509620604, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000556062 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13328, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001978483, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000148 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 2058864, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 249568 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 16967, 2024-04-25T21:00:18.371 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 16621, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 6176344, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 29693170, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 56, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 8, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.962552245, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.387598092, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.509022739, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.150361851, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 16615, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 4.625829204, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000278412 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.372 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 26827, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.003677307, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000137 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 86640, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 166352 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:18.373 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1903, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 15.881468077, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.008345490 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4315, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.720390030, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000166950 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.374 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 11507, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 11466, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 11466, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 85.474254805, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.007454583 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 41, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 1, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 1308, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 11, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 1, 2024-04-25T21:00:18.375 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 1025, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 672, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 322, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 31, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 45, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 7991, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 2, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 2, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 6, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 13240, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 12204, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 445, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:18.376 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 57, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 6560, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 39, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 1524, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 6, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:18.377 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 66, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 3186, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 10939, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 9892, 2024-04-25T21:00:18.378 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 6915, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 31, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 3645 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 1058, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 1348, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 895, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 879, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 2299, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 25, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 2388, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 2363, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:18.379 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 2, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 2031, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 57, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 12, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-04-25T21:00:18.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 23703, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 23635, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 23635, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 68, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 2156, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 42, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 41, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 41, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 1, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 1, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 3, 2024-04-25T21:00:18.381 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 57037081, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 57127086, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2777, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 324.941512704, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.117011707 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 212, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 9787, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 9575, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 81, 2024-04-25T21:00:18.382 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 1262, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 1181, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 1025, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 13020, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 11995, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 2, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 8739, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 8737, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 103048, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 231800 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 13359, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 1683, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 11507, 2024-04-25T21:00:18.383 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 86, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 3594, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7590, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 46.480753509, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.006123946 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 141, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.104998526, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000744670 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 386, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.961123376, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.007671304 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 11, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.002171553, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000197413 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 623, 2024-04-25T21:00:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 27.851165709, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.044704920 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 11, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.056798628, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.005163511 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2024-04-25T21:00:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000212197, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000212197 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 293, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.407677515, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001391390 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.002310109, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001155054 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 215, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.865116393, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.017977285 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 5, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.023358513, 2024-04-25T21:00:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004671702 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 8, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.311261556, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.038907694 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7, 2024-04-25T21:00:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.020178446, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002882635 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2173, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.387128775, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001558733 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 2, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 5, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 3, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 2, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 105, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 52, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 618, 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 360, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 360, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 471507, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 341, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 88, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 1, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 167, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 1419045, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 25894, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 15405, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 67452393, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 37, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 15405, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 15405, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1575.435635809, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.102267811 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 15405, 2024-04-25T21:00:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 33359 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 15405, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 101, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 15304, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 631, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 7946, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 100, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 2877, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 117, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-04-25T21:00:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 11, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 2941, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 15892, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-04-25T21:00:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 102, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 13, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 12, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 12, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 2729, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 112 2024-04-25T21:00:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 2117 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 20, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 6, 2024-04-25T21:00:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 2401, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 2363, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 67305, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 20187517, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 67305, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 67305, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 20187517, 2024-04-25T21:00:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 15405, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 67691208, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 15405, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 67691208, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 15405, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 15405, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 15405, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 15405, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2363, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 238831, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2363, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 100, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 238831, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x55d94549e500": { 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 23703, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 52932782, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 23703, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2777, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 52932782, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:18.411 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds.exported=57 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds.imported=39 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1058 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1348 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-04-25T21:00:19.301 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-04-25T21:00:19.301 DEBUG:tasks.check_counter:Getting stats from e 2024-04-25T21:00:19.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-25T21:00:19.541 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T21:00:19.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:19 smithi112 ceph-mon[32322]: pgmap v323: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T21:00:20.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:19 smithi043 ceph-mon[29167]: pgmap v323: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T21:00:20.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:19 smithi195 ceph-mon[33250]: pgmap v323: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 12 op/s 2024-04-25T21:00:21.347 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1549, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1505, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 14673450, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 544974, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.173350945, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.061567809, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.070389025, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.038576647, 2024-04-25T21:00:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1505, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.069503990, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000046182 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1700336, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 147152 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 130, 2024-04-25T21:00:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 307, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 25202031, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 508706, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 8, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 6, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.031503778, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.009204725, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.016698381, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.002923277, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 304, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.021347127, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000070220 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 467936 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1223, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1225, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 15495428, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 388921, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-04-25T21:00:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.095251873, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.022373167, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.031089816, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.034747228, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1223, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.036681165, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000029992 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4305, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.205654694, 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000047771 2024-04-25T21:00:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2024-04-25T21:00:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 4130, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 2858, 2024-04-25T21:00:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 1272, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 46, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 2, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-04-25T21:00:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 6, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2024-04-25T21:00:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-04-25T21:00:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 23703, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 2, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 18, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 57037081, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 57127086, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 57126974, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 23703 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 618, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 9357, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 8739, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 68, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 752, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 684, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 4130, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 12027, 2024-04-25T21:00:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 7897, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 66276, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 215416 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-04-25T21:00:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-04-25T21:00:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 2, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 5, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 3, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 4, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2024-04-25T21:00:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 3045, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 238368, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 693, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 167, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 4474580, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 51534, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2602, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 26, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 4, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2602, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2602, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.128944127, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000818195 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2602, 2024-04-25T21:00:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2603 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2602, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2602, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1638, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 961, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2024-04-25T21:00:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 2, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-04-25T21:00:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 102, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 13, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 8, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 8, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-04-25T21:00:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2898, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 55092163, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2898, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2898, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 55092163, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2602, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 52941481, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2602, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 52941481, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2602, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2602, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2602, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2602, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-04-25T21:00:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x55b6d41c46e0": { 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-04-25T21:00:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:21.390 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T21:00:21.945 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:21 smithi112 ceph-mon[32322]: pgmap v324: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:22.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:21 smithi043 ceph-mon[29167]: pgmap v324: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:22.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:21 smithi195 ceph-mon[33250]: pgmap v324: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:22.163 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:22.163 DEBUG:tasks.check_counter:Getting stats from h 2024-04-25T21:00:22.164 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-25T21:00:22.402 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T21:00:23.942 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:23 smithi112 ceph-mon[32322]: pgmap v325: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:24.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:23 smithi043 ceph-mon[29167]: pgmap v325: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:24.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:23 smithi195 ceph-mon[33250]: pgmap v325: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 12 op/s 2024-04-25T21:00:24.217 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T21:00:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 13757, 2024-04-25T21:00:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 13903, 2024-04-25T21:00:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 8046937, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 31527414, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 11, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.815513951, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.388433056, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.467238447, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.044867290, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13901, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.335468968, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000024132 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 24523, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.003536609, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000144 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 311760 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 15119, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 33182, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 6883842, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 21691884, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 17, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 1.158952246, 2024-04-25T21:00:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.572616469, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.806749877, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.043695121, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 33181, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.923656326, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000027836 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 39151, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.005706187, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000145 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 5849792, 2024-04-25T21:00:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 14749392 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 6357, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 6577, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 2615317, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 10155076, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 13, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 6, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.400970646, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.159589417, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.193766590, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.059458766, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6575, 2024-04-25T21:00:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.204938675, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000031169 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 8599, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001320037, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000153 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 5008, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 160320 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-04-25T21:00:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 815, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 8.192519605, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.010052171 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6921, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.603569474, 2024-04-25T21:00:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000231696 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 6823, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 6731, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6731, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 15.195796506, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002257583 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 92, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 35, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 3, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 2518, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 331, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 1893, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 294, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 2044, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 2263, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 6, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 8739, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 7472, 2024-04-25T21:00:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 23, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 619, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 1, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 9, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 1310, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 36, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 3379, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-04-25T21:00:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 10, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 1020, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 6679, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 3822, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 2826, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 39, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 4761 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 892, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 1551, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 1056, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 1034, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 1707, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 104, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 4136, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 4032, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 2, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 20, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 9, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 3, 2024-04-25T21:00:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 1, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 15692, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 15692, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 22, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 22, 2024-04-25T21:00:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 3, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 42023967, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 401, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 6.341027265, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.015813035 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1124, 2024-04-25T21:00:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 6925, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 5801, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 186, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 849, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 663, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 2518, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 9933, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 7415, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 4788, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 4788, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 90764, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 223608 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 8647, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 839, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 6823, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 28, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 2047, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1997, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.217264748, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001110297 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.024208993, 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003458427 2024-04-25T21:00:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 173, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.231915303, 2024-04-25T21:00:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.007120897 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.235 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 414, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.490608061, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001185043 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 167, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.272968924, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.019598616 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.946074929, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.486518732 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.241 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.242 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3969, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 6.012755548, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001514929 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:24.243 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 4, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 3, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 1, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 4200, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 4200, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 627, 2024-04-25T21:00:24.244 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:24.245 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:24.246 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 1052961, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 1454, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-04-25T21:00:24.247 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 167, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 4809899, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 78656, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-04-25T21:00:24.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 4755, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 38986662, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 33, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 4755, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4755, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 10.493724429, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002206882 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4755, 2024-04-25T21:00:24.249 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 4870 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 4755, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 75, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 4680, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 10, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 75, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 476, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 43, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-04-25T21:00:24.250 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 3, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 4069, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 20, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:24.251 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-04-25T21:00:24.252 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 102, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 13, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 12, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 12, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 142, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 32 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2024-04-25T21:00:24.253 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 22 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 14, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 6, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 4048, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 4032, 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:24.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 35229, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 13836868, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 35229, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 35229, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 13836868, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.255 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 4755, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 39404886, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 4755, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 39404886, 2024-04-25T21:00:24.256 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 4755, 2024-04-25T21:00:24.257 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 4755, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 4755, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 4755, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 4032, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 418224, 2024-04-25T21:00:24.258 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 4032, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 75, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 418224, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x56207fa34500": { 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:24.259 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 15692, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 37829663, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 15692, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 401, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 37829663, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:24.260 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T21:00:25.066 INFO:tasks.check_counter:Daemon mds.h mds.exported=9 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds.imported=36 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=892 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1551 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:25.067 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:25.067 DEBUG:tasks.check_counter:Getting stats from k 2024-04-25T21:00:25.067 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-25T21:00:25.306 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T21:00:25.708 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:25 smithi112 ceph-mon[32322]: pgmap v326: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T21:00:26.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:25 smithi043 ceph-mon[29167]: pgmap v326: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T21:00:26.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:25 smithi195 ceph-mon[33250]: pgmap v326: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 15 op/s 2024-04-25T21:00:27.109 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-25T21:00:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:27.109 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1604, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 1562, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 10489568, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 565052, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 6, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.168433905, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.059465129, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.068035605, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.038729843, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1561, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.065250078, 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000041800 2024-04-25T21:00:27.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1698544, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 149744 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 477, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 655, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 8595753, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 620368, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 7, 2024-04-25T21:00:27.111 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.051406575, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.019871054, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.015353241, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.010903326, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 653, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.030716153, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000047038 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 470528 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 647, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 649, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 21139056, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 205753, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.052529007, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.010580956, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.023351719, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.015690745, 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:27.113 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 647, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.016823257, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000026001 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-04-25T21:00:27.114 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4089, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.093709961, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000022917 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.115 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 0, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 0, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-04-25T21:00:27.116 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 6757, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 159, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 6598, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 6529, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 0, 2024-04-25T21:00:27.117 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 1, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-04-25T21:00:27.118 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T21:00:27.119 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 0 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 0, 2024-04-25T21:00:27.120 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-04-25T21:00:27.121 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 15692, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-04-25T21:00:27.122 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 22, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 3, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 42023967, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 42021879, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 15692 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.123 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 1123, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 6447, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 5324, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 156, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 310, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 154, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 6757, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 9009, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 2252, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 0, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 0, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 0, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 68324, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 215416 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.124 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:27.127 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.132 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-04-25T21:00:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.134 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 1, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 4, 2024-04-25T21:00:27.135 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 3, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 3, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 4260, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:27.136 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:27.137 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:27.138 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 251622, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 1265, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 167, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-04-25T21:00:27.139 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 7652424, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 87839, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 2424, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 21, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 3, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 2424, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2424, 2024-04-25T21:00:27.140 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.571958771, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000648497 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2424, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2425 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 2424, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 2424, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 0, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 1545, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 0, 2024-04-25T21:00:27.141 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 877, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 1, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:27.142 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-04-25T21:00:27.143 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 102, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 13, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 7, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 7, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-04-25T21:00:27.144 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 0, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 2, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 0 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 0, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:27.145 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 2724, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 39961077, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 2724, 2024-04-25T21:00:27.146 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2724, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 39961077, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:27.147 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2424, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 37831333, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2424, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 37831333, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-04-25T21:00:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 2424, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 2424, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 2424, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 2424, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x555c456c66e0": { 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 0, 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-04-25T21:00:27.151 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-04-25T21:00:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-04-25T21:00:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-04-25T21:00:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-25T21:00:27.152 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-25T21:00:27.925 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:27 smithi112 ceph-mon[32322]: pgmap v327: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:27.926 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-25T21:00:27.926 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-25T21:00:27.926 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-25T21:00:27.926 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-25T21:00:27.927 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-25T21:00:27.927 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:27.927 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:27.927 DEBUG:tasks.check_counter:Getting stats from c 2024-04-25T21:00:27.927 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-25T21:00:27.954 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:27 smithi195 ceph-mon[33250]: pgmap v327: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:28.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:27 smithi043 ceph-mon[29167]: pgmap v327: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:28.176 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T21:00:29.975 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:29 smithi195 ceph-mon[33250]: pgmap v328: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:30.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:29 smithi043 ceph-mon[29167]: pgmap v328: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:30.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:29 smithi112 ceph-mon[32322]: pgmap v328: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 2245, 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 3034, 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 910959, 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 10455413, 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 18, 2024-04-25T21:00:30.110 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 8, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.195928813, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.093412524, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.077826227, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.025803782, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3030, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.109524028, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000036146 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3292, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000572849, 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000174 2024-04-25T21:00:30.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2096, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 316928 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 3531, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 3445, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 2952956, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 5699854, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 9, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.266745644, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.112504755, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.155089710, 2024-04-25T21:00:30.112 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.025310840, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3444, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.109037003, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000031659 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4835, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000909905, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000188 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1719648, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 165792 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.113 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 16378, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 23374, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 7755316, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 12214648, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 13, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 7, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.982748319, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.435780437, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.641068912, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.029924572, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 23374, 2024-04-25T21:00:30.114 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.632374892, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000027054 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 34844, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.005422400, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000155 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1984464, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 6723904 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-04-25T21:00:30.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 639, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.729122294, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.004270926 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3497, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.319098061, 2024-04-25T21:00:30.116 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000091249 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 3392, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 3365, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3365, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5.874265323, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001745695 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 27, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:30.117 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 35, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 3, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 349, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 8, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 8, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 333, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 336, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 1399, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 1, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 2, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 6, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 6671, 2024-04-25T21:00:30.118 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 4708, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 20, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 740, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 1000, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 1, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 26, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 533, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 15, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 1683, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:30.119 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 4, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 234, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 10, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 631, 2024-04-25T21:00:30.120 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 2778, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 1621, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 1025, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 20, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 2969 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 329, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 2007, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 1367, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 1255, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 652, 2024-04-25T21:00:30.121 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 25, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 1966, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 1941, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-04-25T21:00:30.122 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_path": 2, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_inode": 20, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 27, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 3, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 6845, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 6845, 2024-04-25T21:00:30.123 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 10, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 10, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 18092279, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 263, 2024-04-25T21:00:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.890271355, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003385062 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 204, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 2888, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2684, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 55, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 842, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 787, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 349, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 4761, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4412, 2024-04-25T21:00:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 2, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 1982, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 1980, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 72516, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 223608 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 5170, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 194, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 3392, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 26, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 1530, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 583, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.628837262, 2024-04-25T21:00:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001078623 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 9, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.005419754, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000602194 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 665, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.238488145, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000358628 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000144240, 2024-04-25T21:00:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000144240 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-04-25T21:00:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-04-25T21:00:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 138, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.195539379, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001416952 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 96, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.503061402, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.015656889 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.377657123, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.125885707 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1870, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.925118018, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001564234 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 4, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 2, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 2485, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 1242, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 614, 2024-04-25T21:00:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 512442, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 362, 2024-04-25T21:00:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 167, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 848241, 2024-04-25T21:00:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 11929, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 2495, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 14554417, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 29, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 2495, 2024-04-25T21:00:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2495, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 6.472880463, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002594340 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2495, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2605 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 2495, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 64, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 2431, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-04-25T21:00:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 64, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 327, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 38, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 3, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 1972, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-04-25T21:00:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-04-25T21:00:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 102, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-04-25T21:00:30.146 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 13, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 141, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 30 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.147 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 22 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 14, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 6, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed_ops": 1957, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 1941, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:30.148 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 22150, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 9362974, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 22150, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 22150, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 9362974, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:30.149 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2495, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 14752146, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2495, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 14752146, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.150 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2495, 2024-04-25T21:00:30.151 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 2495, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2495, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2495, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1941, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 197729, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:30.152 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1941, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 64, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 197729, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55e56e8cc500": { 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 6845, 2024-04-25T21:00:30.153 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 13897975, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 6845, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 263, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 13897975, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:30.154 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T21:00:30.918 INFO:tasks.check_counter:Daemon mds.c mds.exported=26 2024-04-25T21:00:30.918 INFO:tasks.check_counter:Daemon mds.c mds.imported=15 2024-04-25T21:00:30.918 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=329 2024-04-25T21:00:30.918 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2007 2024-04-25T21:00:30.919 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-04-25T21:00:30.919 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:30.919 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:30.919 DEBUG:tasks.check_counter:Getting stats from f 2024-04-25T21:00:30.919 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-25T21:00:31.204 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T21:00:32.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:31 smithi043 ceph-mon[29167]: pgmap v329: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:32.089 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:31 smithi195 ceph-mon[33250]: pgmap v329: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:32.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:31 smithi112 ceph-mon[32322]: pgmap v329: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 7555, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 7431, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 4134819, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 6058671, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 13, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:33.006 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.412296572, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.161637421, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.276849492, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.024080362, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 7427, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.245201712, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000033014 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 13309, 2024-04-25T21:00:33.007 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.002094803, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000157 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2656, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 7088 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 8610, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 11969, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 5233945, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 5831877, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 15, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 7, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.529087214, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.228920342, 2024-04-25T21:00:33.008 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.358715550, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.020333307, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11969, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.252605161, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000021104 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 17018, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.002368715, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000139 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2965904, 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 4907456 2024-04-25T21:00:33.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4795, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 3720, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 2151337, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 8363062, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 13, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.281267848, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.131437193, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.160850176, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.018310795, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3719, 2024-04-25T21:00:33.010 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.108065910, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000029057 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6861, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000969265, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000141 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 471344 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-04-25T21:00:33.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 438, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.702628782, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003887280 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2776, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.370696494, 2024-04-25T21:00:33.012 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000133536 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 2634, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 2634, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2634, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.401857478, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001671168 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2024-04-25T21:00:33.013 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 11, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 75, 2024-04-25T21:00:33.014 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 14, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 11, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 50, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 53, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 1244, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 1, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 1, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 6, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 5466, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 3901, 2024-04-25T21:00:33.015 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 797, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 1000, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 1, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 18, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 122, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 21, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 1141, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 4, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 234, 2024-04-25T21:00:33.016 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 6, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 146, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 2151, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:33.017 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 637, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 504, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 20, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 2195 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 148, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 2178, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 1480, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 1372, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 253, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 6, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 1549, 2024-04-25T21:00:33.018 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 1543, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_path": 2, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_inode": 20, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 18, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-04-25T21:00:33.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 5265, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 5265, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 7, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 7, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2024-04-25T21:00:33.020 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 14866387, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 183, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.578799433, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.008627319 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 57, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 2195, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2138, 2024-04-25T21:00:33.021 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 39, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 843, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 804, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 75, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 3823, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 3748, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 1, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 1565, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 1564, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 69304, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 223608 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 3829, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 87, 2024-04-25T21:00:33.022 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 2634, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 30, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 855, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 470, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.419438890, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000892423 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.023 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 537, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.165498260, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000308190 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:33.024 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000162057, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000162057 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.026 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-04-25T21:00:33.027 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.028 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 74, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.060596607, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000818873 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.029 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 53, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.857995737, 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.016188598 2024-04-25T21:00:33.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.583516711, 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.194505570 2024-04-25T21:00:33.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.032 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1496, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.314649216, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001547225 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:33.033 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 5, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 3, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-04-25T21:00:33.034 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 2084, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 1042, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 621, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:33.035 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:33.036 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 329241, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 140, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:33.037 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 167, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 266365, 2024-04-25T21:00:33.038 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 2640, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 1917, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 10965928, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 33, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 1917, 2024-04-25T21:00:33.039 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1917, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 4.760912060, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002483522 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1917, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1974 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 1917, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 47, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 1870, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-04-25T21:00:33.040 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 47, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 230, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 30, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 1565, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:33.041 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-04-25T21:00:33.042 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-04-25T21:00:33.043 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 102, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 13, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 54, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 18 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-04-25T21:00:33.044 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 22 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 9, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 6, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed_ops": 1551, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 1543, 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:33.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 20956, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 9458548, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 20956, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 20956, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 9458548, 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:33.046 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1917, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 11121883, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1917, 2024-04-25T21:00:33.047 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 11121883, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:33.048 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 1917, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 1917, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1917, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1917, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:33.049 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1543, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 155955, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1543, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 47, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 155955, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.050 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55f101ed8500": { 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 5265, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 10672083, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 5265, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 183, 2024-04-25T21:00:33.051 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 10672083, 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:33.052 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T21:00:33.864 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:33 smithi195 ceph-mon[33250]: pgmap v330: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:33.892 INFO:tasks.check_counter:Daemon mds.f mds.exported=18 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds.imported=21 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=148 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=2178 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:33.893 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:33.893 DEBUG:tasks.check_counter:Getting stats from i 2024-04-25T21:00:33.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-25T21:00:34.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:33 smithi043 ceph-mon[29167]: pgmap v330: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:34.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:33 smithi112 ceph-mon[32322]: pgmap v330: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:34.134 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T21:00:35.935 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:35 smithi195 ceph-mon[33250]: pgmap v331: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:35.961 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 3308, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 3348, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 2866151, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 4633090, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 18, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.271432917, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.122054038, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.150074857, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.022442642, 2024-04-25T21:00:35.962 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3345, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.113866016, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000034040 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4779, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000850239, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000177 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1722720, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 154576 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 5154, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 11288, 2024-04-25T21:00:35.963 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1834212, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 10705269, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 14, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 9, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.434788011, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.213250273, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.221613702, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.029428565, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11282, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.350280289, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000031047 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 11953, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.001968498, 2024-04-25T21:00:35.964 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000164 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1607280, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 5959024 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 13223, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 14024, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 6612862, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 9794344, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 8, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.698385454, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.292985331, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.473983787, 2024-04-25T21:00:35.965 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.023507006, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 14028, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.323625420, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000023069 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 25197, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.004468475, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000177 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:35.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 565, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.119727455, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003751730 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:35.967 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3024, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.386626832, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000127852 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 2698, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 2663, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2663, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5.648060406, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002120938 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 35, 2024-04-25T21:00:35.968 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 19, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 1, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 810, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 5, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 4, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 801, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 801, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 1408, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 5, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 5236, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 3561, 2024-04-25T21:00:35.969 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 32, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 720, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 1000, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 1, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 20, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 466, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 19, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 1264, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 4, 2024-04-25T21:00:35.970 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 234, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 8, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 498, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 2486, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:35.971 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 1321, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 848, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 19, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 2312 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 462, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 1908, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 1305, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 1190, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 819, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 46, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 1722, 2024-04-25T21:00:35.972 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 1676, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_path": 2, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_inode": 20, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 20, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 1, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:35.973 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 5278, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 5278, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 7, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 7, 2024-04-25T21:00:35.974 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 16526873, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 258, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.724324006, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002807457 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 457, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 2862, 2024-04-25T21:00:35.975 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2405, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 70, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 830, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 760, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 810, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 4500, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 3690, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 1734, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 1734, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 71112, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 223608 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 4526, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 127, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 2698, 2024-04-25T21:00:35.976 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 16, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 894, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 508, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.518497891, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001020665 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.003536059, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000884014 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.977 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 252, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.082880309, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000328890 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.979 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.980 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.981 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 174, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.222973823, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001281458 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-04-25T21:00:35.982 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.983 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 86, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.550094339, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.018024352 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 3, 2024-04-25T21:00:35.984 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.458329358, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.152776452 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.985 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1636, 2024-04-25T21:00:35.986 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.811748627, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001718672 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 3, 2024-04-25T21:00:35.987 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 2, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 1927, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 1927, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 490, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:35.988 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:35.989 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:35.990 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 649423, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 638, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:35.991 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 167, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 1834185, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 27172, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-04-25T21:00:35.992 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 2191, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 12841333, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 33, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 2191, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2191, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5.491898519, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002506571 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2191, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2273 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.993 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 2191, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 61, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 2130, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 61, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 319, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 39, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 1, 2024-04-25T21:00:35.994 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 1706, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:35.995 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-04-25T21:00:35.996 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 102, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 13, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 96, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 21 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-04-25T21:00:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 22 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 14, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 6, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed_ops": 1692, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 1676, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:35.998 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 21681, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 9144739, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 21681, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 21681, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 9144739, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:35.999 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2191, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 13014737, 2024-04-25T21:00:36.000 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2191, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 13014737, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:36.001 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2191, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 2191, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2191, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2191, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:36.002 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1676, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 173404, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1676, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 61, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 173404, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x55ef9ac64500": { 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 5278, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 12332569, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 5278, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 258, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 12332569, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:36.004 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:36.005 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:36.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:36.005 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T21:00:36.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:35 smithi043 ceph-mon[29167]: pgmap v331: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:36.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:35 smithi112 ceph-mon[32322]: pgmap v331: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds.exported=20 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds.imported=19 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=462 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1908 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:36.792 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:36.792 DEBUG:tasks.check_counter:Getting stats from l 2024-04-25T21:00:36.792 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-25T21:00:37.034 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T21:00:37.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:37 smithi195 ceph-mon[33250]: pgmap v332: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:38.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:37 smithi043 ceph-mon[29167]: pgmap v332: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:38.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:37 smithi112 ceph-mon[32322]: pgmap v332: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:38.836 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-25T21:00:38.836 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T21:00:38.836 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 392, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 394, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 4300744, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 124720, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 6, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.040378075, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.010923331, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.013461823, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.012025028, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 392, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.015664421, 2024-04-25T21:00:38.837 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000039960 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1038, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 996, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 6076070, 2024-04-25T21:00:38.838 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 386053, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 4, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.125430240, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.038992035, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.057125991, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.032071550, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 995, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.042702340, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000042916 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:38.839 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1700256, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 152000 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1312, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1493, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 4350545, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 889596, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2024-04-25T21:00:38.840 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.157782751, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.052281204, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.040085775, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.046987635, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1491, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.078343211, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000052544 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.841 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 474288 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4095, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.125868604, 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000030737 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.843 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 2479, 2024-04-25T21:00:38.844 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 2479, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 2478, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 1, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2024-04-25T21:00:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T21:00:38.846 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.847 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2024-04-25T21:00:38.848 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_path": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_quiesce_inode": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "evlrg": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 0, 2024-04-25T21:00:38.849 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 5278, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 7, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segmjr": 2, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2024-04-25T21:00:38.850 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 16526873, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 16524785, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 5278 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 441, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 2330, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 1889, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 53, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 170, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 117, 2024-04-25T21:00:38.851 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 2479, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 3599, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 1120, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 59548, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 215416 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2024-04-25T21:00:38.852 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.853 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.854 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.855 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.856 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.857 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.858 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.859 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.860 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.862 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 1, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 3, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 2, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 1, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 1853, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "mdthresh_evicted": 0 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.863 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T21:00:38.864 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2024-04-25T21:00:38.865 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 216827, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 539, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2024-04-25T21:00:38.866 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 8032, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 167, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 2903193, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 30467, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2024-04-25T21:00:38.867 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 2434, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 21, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 3, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 2434, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2434, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2.158960127, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000887000 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2434, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 2435 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.868 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 2434, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 2434, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 1552, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 880, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2024-04-25T21:00:38.869 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 1, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2024-04-25T21:00:38.870 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2024-04-25T21:00:38.871 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 102, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 13, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 6, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 6, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 2, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 0 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2024-04-25T21:00:38.872 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed_ops": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.873 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 2738, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 14462604, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 2738, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2738, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 14462604, 2024-04-25T21:00:38.874 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:38.875 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2434, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 12336055, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2434, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 12336055, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2024-04-25T21:00:38.876 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 2434, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 2434, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 2434, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 2434, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.877 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:38.878 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x5627e751c6e0": { 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2024-04-25T21:00:38.879 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-25T21:00:38.880 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-25T21:00:39.662 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-25T21:00:39.662 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-25T21:00:39.662 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-04-25T21:00:39.663 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-04-25T21:00:39.663 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-25T21:00:39.663 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-25T21:00:39.663 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T21:00:39.663 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T21:00:39.679 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T21:00:39.680 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T21:00:39.680 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T21:00:39.701 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-25T21:00:39.701 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T21:00:39.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd blocklist ls 2024-04-25T21:00:40.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:39 smithi043 ceph-mon[29167]: pgmap v333: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:40.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:39 smithi195 ceph-mon[33250]: pgmap v333: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:40.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:39 smithi112 ceph-mon[32322]: pgmap v333: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 -- 172.21.15.43:0/450806666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218102a90 msgr2=0x7f3218102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 --2- 172.21.15.43:0/450806666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218102a90 0x7f3218102f10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3200009990 tx=0x7f3200009ca0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 -- 172.21.15.43:0/450806666 shutdown_connections 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 --2- 172.21.15.43:0/450806666 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 0x7f321810f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 --2- 172.21.15.43:0/450806666 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218108a50 0x7f3218108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 --2- 172.21.15.43:0/450806666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218102a90 0x7f3218102f10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 -- 172.21.15.43:0/450806666 >> 172.21.15.43:0/450806666 conn(0x7f3218079ba0 msgr2=0x7f3218079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 -- 172.21.15.43:0/450806666 shutdown_connections 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 -- 172.21.15.43:0/450806666 wait complete. 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.775+0000 7f321d4ca700 1 Processor -- start 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 -- start start 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218102a90 0x7f3218074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 0x7f3218075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112da0 con 0x7f3218108a50 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112c20 con 0x7f3218102a90 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f321d4ca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3218112f20 con 0x7f3218103450 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f3216ffd700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218102a90 0x7f3218074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49654/0 (socket says 172.21.15.43:49654) 2024-04-25T21:00:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 -- 172.21.15.43:0/1190877417 learned_addr learned my addr 172.21.15.43:0/1190877417 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32167fc700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 0x7f3218075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 -- 172.21.15.43:0/1190877417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 msgr2=0x7f3218075280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 0x7f3218075280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 -- 172.21.15.43:0/1190877417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218102a90 msgr2=0x7f3218074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218102a90 0x7f3218074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.776+0000 7f32177fe700 1 -- 172.21.15.43:0/1190877417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32181a7780 con 0x7f3218108a50 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f32177fe700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f320800c970 tx=0x7f320800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208004a30 con 0x7f3218108a50 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32181a7a70 con 0x7f3218108a50 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f32080054f0 con 0x7f3218108a50 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320800ec30 con 0x7f3218108a50 2024-04-25T21:00:41.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.777+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32181a7f80 con 0x7f3218108a50 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.778+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3218069730 con 0x7f3218108a50 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.779+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3208004bd0 con 0x7f3218108a50 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.780+0000 7f320ffff700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 0x7f32040a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.780+0000 7f3216ffd700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 0x7f32040a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.780+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8513+0+0 (secure 0 0 0) 0x7f32080d06f0 con 0x7f3218108a50 2024-04-25T21:00:41.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.780+0000 7f3216ffd700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 0x7f32040a6270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f321000f540 tx=0x7f321000b040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:41.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:41.784+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3208014030 con 0x7f3218108a50 2024-04-25T21:00:42.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.006+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f321802df80 con 0x7f3218108a50 2024-04-25T21:00:42.008 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:41 smithi043 ceph-mon[29167]: pgmap v334: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:42.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.007+0000 7f320ffff700 1 -- 172.21.15.43:0/1190877417 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v102) ==== 81+0+944 (secure 0 0 0) 0x7f320809cd90 con 0x7f3218108a50 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1916899701 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/3531160359 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/3531160359 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3360697116 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1294774526 2024-04-26T20:39:04.572932+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/801305986 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/1388340659 2024-04-26T20:39:04.572932+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/1388340659 2024-04-26T20:39:04.572932+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6800/2222849100 2024-04-26T20:38:37.272305+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/1350680357 2024-04-26T20:49:58.419352+0000 2024-04-25T21:00:42.009 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2986666548 2024-04-26T20:38:37.272305+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:6801/2222849100 2024-04-26T20:38:37.272305+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/544130458 2024-04-26T20:39:04.572932+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/3989115997 2024-04-26T20:38:37.272305+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/4191607377 2024-04-26T20:39:04.572932+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43:0/2191695289 2024-04-26T20:38:37.272305+0000 2024-04-25T21:00:42.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 msgr2=0x7f32040a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 0x7f32040a6270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f321000f540 tx=0x7f321000b040 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 msgr2=0x7f32180757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f320800c970 tx=0x7f320800cc80 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 shutdown_connections 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f32040a3db0 0x7f32040a6270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3218108a50 0x7f32180757c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3218102a90 0x7f3218074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 --2- 172.21.15.43:0/1190877417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3218103450 0x7f3218075280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 >> 172.21.15.43:0/1190877417 conn(0x7f3218079ba0 msgr2=0x7f3218101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 shutdown_connections 2024-04-25T21:00:42.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:42.009+0000 7f321d4ca700 1 -- 172.21.15.43:0/1190877417 wait complete. 2024-04-25T21:00:42.012 INFO:teuthology.orchestra.run.smithi043.stderr:listed 16 entries 2024-04-25T21:00:42.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:41 smithi195 ceph-mon[33250]: pgmap v334: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:42.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:41 smithi112 ceph-mon[32322]: pgmap v334: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 14 op/s 2024-04-25T21:00:42.671 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T21:00:42.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T21:00:42.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T21:00:42.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T21:00:42.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T21:00:42.738 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T21:00:42.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T21:00:42.787 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-04-25T21:00:42.826 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T21:00:42.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T21:00:42.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T21:00:42.918 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:42 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1190877417' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T21:00:42.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T21:00:42.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-04-25T21:00:43.015 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T21:00:43.026 INFO:tasks.cephadm:Teardown begin 2024-04-25T21:00:43.027 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T21:00:43.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T21:00:43.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:42 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1190877417' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T21:00:43.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:42 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1190877417' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T21:00:43.351 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:43.723 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:43 smithi043 ceph-mon[29167]: pgmap v335: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:44.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:43 smithi195 ceph-mon[33250]: pgmap v335: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:44.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:43 smithi112 ceph-mon[32322]: pgmap v335: 97 pgs: 97 active+clean; 76 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 -- 172.21.15.43:0/706960769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30102a90 msgr2=0x7fcb30102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 --2- 172.21.15.43:0/706960769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30102a90 0x7fcb30102f10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009990 tx=0x7fcb24009ca0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 -- 172.21.15.43:0/706960769 shutdown_connections 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 --2- 172.21.15.43:0/706960769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb30108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 --2- 172.21.15.43:0/706960769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30103450 0x7fcb3010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 --2- 172.21.15.43:0/706960769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30102a90 0x7fcb30102f10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 -- 172.21.15.43:0/706960769 >> 172.21.15.43:0/706960769 conn(0x7fcb30079ba0 msgr2=0x7fcb30079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 -- 172.21.15.43:0/706960769 shutdown_connections 2024-04-25T21:00:45.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.061+0000 7fcb36432700 1 -- 172.21.15.43:0/706960769 wait complete. 2024-04-25T21:00:45.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 Processor -- start 2024-04-25T21:00:45.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 -- start start 2024-04-25T21:00:45.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30102a90 0x7fcb30074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:45.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb300757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30112da0 con 0x7fcb30103450 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30112c20 con 0x7fcb30102a90 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.062+0000 7fcb36432700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30112f20 con 0x7fcb30108a50 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49672/0 (socket says 172.21.15.43:49672) 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/2374819543 learned_addr learned my addr 172.21.15.43:0/2374819543 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb349cf700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb300757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2ffff700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30102a90 0x7fcb30074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/2374819543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 msgr2=0x7fcb300757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb300757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/2374819543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30102a90 msgr2=0x7fcb30074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30102a90 0x7fcb30074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 -- 172.21.15.43:0/2374819543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb301a7800 con 0x7fcb30103450 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb349cf700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb300757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2f7fe700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24027070 con 0x7fcb30103450 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.063+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb301a7a90 con 0x7fcb30103450 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.064+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb240040f0 con 0x7fcb30103450 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.064+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400f460 con 0x7fcb30103450 2024-04-25T21:00:45.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.064+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb301a7fc0 con 0x7fcb30103450 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.065+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb30069730 con 0x7fcb30103450 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.066+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fcb2402a070 con 0x7fcb30103450 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.066+0000 7fcb2d7fa700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 0x7fcb180a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.066+0000 7fcb2ffff700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 0x7fcb180a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.066+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8513+0+0 (secure 0 0 0) 0x7fcb240d1700 con 0x7fcb30103450 2024-04-25T21:00:45.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.067+0000 7fcb2ffff700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 0x7fcb180a6270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009a10 tx=0x7fcb20009190 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:45.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.071+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcb2405eff0 con 0x7fcb30103450 2024-04-25T21:00:45.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.325+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb3002df80 con 0x7fcb30103450 2024-04-25T21:00:45.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.325+0000 7fcb2d7fa700 1 -- 172.21.15.43:0/2374819543 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+11936 (secure 0 0 0) 0x7fcb24013070 con 0x7fcb30103450 2024-04-25T21:00:45.327 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T21:00:45.327 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:56:07.370008+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24449,24470,24448,24430,24424]},"id":1}]} 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.327+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 msgr2=0x7fcb180a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.327+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 0x7fcb180a6270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009a10 tx=0x7fcb20009190 comp rx=0 tx=0).stop 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 msgr2=0x7fcb30075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb240047b0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 shutdown_connections 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fcb180a3db0 0x7fcb180a6270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb30108a50 0x7fcb300757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcb30102a90 0x7fcb30074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 --2- 172.21.15.43:0/2374819543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb30103450 0x7fcb30075280 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 >> 172.21.15.43:0/2374819543 conn(0x7fcb30079ba0 msgr2=0x7fcb301017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 shutdown_connections 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:45.328+0000 7fcb36432700 1 -- 172.21.15.43:0/2374819543 wait complete. 2024-04-25T21:00:45.330 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2024-04-25T21:00:46.004 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:45 smithi043 ceph-mon[29167]: pgmap v336: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:46.004 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:45 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2374819543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:46.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-25T21:00:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:45 smithi195 ceph-mon[33250]: pgmap v336: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:46.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:45 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2374819543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:45 smithi112 ceph-mon[32322]: pgmap v336: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:46.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:45 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2374819543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:46.285 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:47.779 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:47 smithi043 ceph-mon[29167]: pgmap v337: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:48.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 -- 172.21.15.43:0/1629444182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980108a50 msgr2=0x7ff980108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:48.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 --2- 172.21.15.43:0/1629444182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980108a50 0x7ff980108e30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff970009990 tx=0x7ff970009ca0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 -- 172.21.15.43:0/1629444182 shutdown_connections 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 --2- 172.21.15.43:0/1629444182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980103450 0x7ff98010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 --2- 172.21.15.43:0/1629444182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980108a50 0x7ff980108e30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 --2- 172.21.15.43:0/1629444182 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 -- 172.21.15.43:0/1629444182 >> 172.21.15.43:0/1629444182 conn(0x7ff980079ba0 msgr2=0x7ff980079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 -- 172.21.15.43:0/1629444182 shutdown_connections 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.015+0000 7ff984905700 1 -- 172.21.15.43:0/1629444182 wait complete. 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 Processor -- start 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 -- start start 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980108a50 0x7ff9800757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff980112da0 con 0x7ff980103450 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff980112c20 con 0x7ff980102a90 2024-04-25T21:00:48.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff984905700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff980112f20 con 0x7ff980108a50 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36046/0 (socket says 172.21.15.43:36046) 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 -- 172.21.15.43:0/1203574079 learned_addr learned my addr 172.21.15.43:0/1203574079 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff97ed9d700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980108a50 0x7ff9800757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff97e59c700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 -- 172.21.15.43:0/1203574079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980108a50 msgr2=0x7ff9800757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980108a50 0x7ff9800757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 -- 172.21.15.43:0/1203574079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 msgr2=0x7ff980074d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980074d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff977fff700 1 -- 172.21.15.43:0/1203574079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9801a76b0 con 0x7ff980103450 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.016+0000 7ff97e59c700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff977fff700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff96800c9b0 tx=0x7ff96800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968007b00 con 0x7ff980103450 2024-04-25T21:00:48.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9801a79a0 con 0x7ff980103450 2024-04-25T21:00:48.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff968007ca0 con 0x7ff980103450 2024-04-25T21:00:48.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968018640 con 0x7ff980103450 2024-04-25T21:00:48.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.017+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801a7f30 con 0x7ff980103450 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.018+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff980069730 con 0x7ff980103450 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.019+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ff9680188a0 con 0x7ff980103450 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.020+0000 7ff9777fe700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 0x7ff96c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.020+0000 7ff97e59c700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 0x7ff96c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.020+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8513+0+0 (secure 0 0 0) 0x7ff9680d0a70 con 0x7ff980103450 2024-04-25T21:00:48.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.020+0000 7ff97e59c700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 0x7ff96c0a62f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff970006010 tx=0x7ff97000b540 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:48.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.023+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff968014030 con 0x7ff980103450 2024-04-25T21:00:48.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:47 smithi195 ceph-mon[33250]: pgmap v337: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:48.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:47 smithi112 ceph-mon[32322]: pgmap v337: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:48.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.278+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff98002e020 con 0x7ff980103450 2024-04-25T21:00:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.278+0000 7ff9777fe700 1 -- 172.21.15.43:0/1203574079 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+11936 (secure 0 0 0) 0x7ff96809d1c0 con 0x7ff980103450 2024-04-25T21:00:48.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T21:00:48.280 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3741268210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3741268210},{"type":"v1","addr":"172.21.15.43:6835","nonce":3741268210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14502,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4072774695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4072774695},{"type":"v1","addr":"172.21.15.43:6837","nonce":4072774695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T20:46:27.488319+0000","modified":"2024-04-25T20:56:07.370008+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24470,"mds_1":24449,"mds_2":24448,"mds_3":24430,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14556":{"gid":14556,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6839/283016818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6838","nonce":283016818},{"type":"v1","addr":"172.21.15.43:6839","nonce":283016818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6841/2354201113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6840","nonce":2354201113},{"type":"v1","addr":"172.21.15.43:6841","nonce":2354201113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2602577561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2602577561},{"type":"v1","addr":"172.21.15.195:6833","nonce":2602577561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6833/2634876322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":2634876322},{"type":"v1","addr":"172.21.15.112:6833","nonce":2634876322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.112:6835/1792854312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1792854312},{"type":"v1","addr":"172.21.15.112:6835","nonce":1792854312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":15,"addr":"172.21.15.195:6835/1478210024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1478210024},{"type":"v1","addr":"172.21.15.195:6835","nonce":1478210024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":14,"addr":"172.21.15.195:6837/97560283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":97560283},{"type":"v1","addr":"172.21.15.195:6837","nonce":97560283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.195:6839/4260595708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":4260595708},{"type":"v1","addr":"172.21.15.195:6839","nonce":4260595708}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.112:6837/246583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":246583870},{"type":"v1","addr":"172.21.15.112:6837","nonce":246583870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.112:6839/2400080298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":2400080298},{"type":"v1","addr":"172.21.15.112:6839","nonce":2400080298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24449,24470,24448,24430,24424]},"id":1}]} 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.280+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 msgr2=0x7ff96c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.280+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 0x7ff96c0a62f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff970006010 tx=0x7ff97000b540 comp rx=0 tx=0).stop 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 msgr2=0x7ff980075280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff96800c9b0 tx=0x7ff96800ccc0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 shutdown_connections 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7ff96c0a3e30 0x7ff96c0a62f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff980108a50 0x7ff9800757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff980102a90 0x7ff980074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 --2- 172.21.15.43:0/1203574079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff980103450 0x7ff980075280 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:48.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 >> 172.21.15.43:0/1203574079 conn(0x7ff980079ba0 msgr2=0x7ff9801016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:48.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 shutdown_connections 2024-04-25T21:00:48.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:48.281+0000 7ff984905700 1 -- 172.21.15.43:0/1203574079 wait complete. 2024-04-25T21:00:48.283 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2024-04-25T21:00:48.964 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:48 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1203574079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:48.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T21:00:49.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:48 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1203574079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:49.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:48 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1203574079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T21:00:49.247 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:50.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:49 smithi043 ceph-mon[29167]: pgmap v338: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:50.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:49 smithi195 ceph-mon[33250]: pgmap v338: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:50.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:49 smithi112 ceph-mon[32322]: pgmap v338: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 -- 172.21.15.43:0/119298997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0103450 msgr2=0x7f2aa010f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/119298997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0103450 0x7f2aa010f8b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800b0a0 tx=0x7f2a9800b3b0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 -- 172.21.15.43:0/119298997 shutdown_connections 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/119298997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0108a50 0x7f2aa0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/119298997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0103450 0x7f2aa010f8b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/119298997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 -- 172.21.15.43:0/119298997 >> 172.21.15.43:0/119298997 conn(0x7f2aa0079ba0 msgr2=0x7f2aa0079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 -- 172.21.15.43:0/119298997 shutdown_connections 2024-04-25T21:00:50.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.983+0000 7f2aa75b5700 1 -- 172.21.15.43:0/119298997 wait complete. 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 Processor -- start 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 -- start start 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0103450 0x7f2aa0199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:50.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa0112da0 con 0x7f2aa0108a50 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa0112c20 con 0x7f2aa0102a90 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa75b5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa0112f20 con 0x7f2aa0103450 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.984+0000 7f2aa5b52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36050/0 (socket says 172.21.15.43:36050) 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 -- 172.21.15.43:0/3193855347 learned_addr learned my addr 172.21.15.43:0/3193855347 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5351700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa4b50700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0103450 0x7f2aa0199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 -- 172.21.15.43:0/3193855347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0103450 msgr2=0x7f2aa0199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0103450 0x7f2aa0199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 -- 172.21.15.43:0/3193855347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 msgr2=0x7f2aa0199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 -- 172.21.15.43:0/3193855347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa019e160 con 0x7f2aa0108a50 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5351700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa5b52700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800b830 tx=0x7f2a98007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a98021020 con 0x7f2aa0108a50 2024-04-25T21:00:50.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa019e3f0 con 0x7f2aa0108a50 2024-04-25T21:00:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a9801db40 con 0x7f2aa0108a50 2024-04-25T21:00:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9801bcf0 con 0x7f2aa0108a50 2024-04-25T21:00:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.985+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa01a5cd0 con 0x7f2aa0108a50 2024-04-25T21:00:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.986+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa0069730 con 0x7f2aa0108a50 2024-04-25T21:00:50.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.987+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2a98024020 con 0x7f2aa0108a50 2024-04-25T21:00:50.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.988+0000 7f2a927fc700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 0x7f2a8c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:50.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.988+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8513+0+0 (secure 0 0 0) 0x7f2a9800f020 con 0x7f2aa0108a50 2024-04-25T21:00:50.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.988+0000 7f2aa5351700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 0x7f2a8c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:50.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.989+0000 7f2aa5351700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 0x7f2a8c0a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a94007900 tx=0x7f2a94008040 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:50.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:50.992+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2a9809ee60 con 0x7f2aa0108a50 2024-04-25T21:00:51.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.200+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2aa002df80 con 0x7f2aa0108a50 2024-04-25T21:00:51.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.201+0000 7f2a927fc700 1 -- 172.21.15.43:0/3193855347 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+23097 (secure 0 0 0) 0x7f2a9809e760 con 0x7f2aa0108a50 2024-04-25T21:00:51.203 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-25T21:00:51.203 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"fsid":"92e6f50e-0343-11ef-bc93-c7b262605968","created":"2024-04-25T20:37:59.861097+0000","modified":"2024-04-25T21:00:12.651368+0000","last_up_change":"2024-04-25T20:45:22.002355+0000","last_in_change":"2024-04-25T20:45:01.485488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T20:41:30.665993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T20:46:19.470974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T20:46:23.606562+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4c56ba7-7f1c-4efe-b163-b34e794c2af2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6803","nonce":1217576324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6805","nonce":1217576324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6809","nonce":1217576324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1217576324},{"type":"v1","addr":"172.21.15.43:6807","nonce":1217576324}]},"public_addr":"172.21.15.43:6803/1217576324","cluster_addr":"172.21.15.43:6805/1217576324","heartbeat_back_addr":"172.21.15.43:6809/1217576324","heartbeat_front_addr":"172.21.15.43:6807/1217576324","state":["exists","up"]},{"osd":1,"uuid":"9d509437-4cc7-4b3c-aedd-d207aac56272","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6801","nonce":3348323695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6803","nonce":3348323695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6807","nonce":3348323695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3348323695},{"type":"v1","addr":"172.21.15.112:6805","nonce":3348323695}]},"public_addr":"172.21.15.112:6801/3348323695","cluster_addr":"172.21.15.112:6803/3348323695","heartbeat_back_addr":"172.21.15.112:6807/3348323695","heartbeat_front_addr":"172.21.15.112:6805/3348323695","state":["exists","up"]},{"osd":2,"uuid":"a14b64b6-b983-417a-b55b-9c2c73ad97a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6801","nonce":2000658150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6803","nonce":2000658150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6807","nonce":2000658150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2000658150},{"type":"v1","addr":"172.21.15.195:6805","nonce":2000658150}]},"public_addr":"172.21.15.195:6801/2000658150","cluster_addr":"172.21.15.195:6803/2000658150","heartbeat_back_addr":"172.21.15.195:6807/2000658150","heartbeat_front_addr":"172.21.15.195:6805/2000658150","state":["exists","up"]},{"osd":3,"uuid":"f20ea1a7-c87a-42fc-a98f-e7874e1560db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6811","nonce":3411063045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6813","nonce":3411063045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6817","nonce":3411063045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":3411063045},{"type":"v1","addr":"172.21.15.43:6815","nonce":3411063045}]},"public_addr":"172.21.15.43:6811/3411063045","cluster_addr":"172.21.15.43:6813/3411063045","heartbeat_back_addr":"172.21.15.43:6817/3411063045","heartbeat_front_addr":"172.21.15.43:6815/3411063045","state":["exists","up"]},{"osd":4,"uuid":"ad2a45ec-e0cc-4b1d-bf93-a5380ff3e063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6809","nonce":429665117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6811","nonce":429665117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6815","nonce":429665117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":429665117},{"type":"v1","addr":"172.21.15.112:6813","nonce":429665117}]},"public_addr":"172.21.15.112:6809/429665117","cluster_addr":"172.21.15.112:6811/429665117","heartbeat_back_addr":"172.21.15.112:6815/429665117","heartbeat_front_addr":"172.21.15.112:6813/429665117","state":["exists","up"]},{"osd":5,"uuid":"655a8020-e914-4eb9-8eb6-b00c7f1a68e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6809","nonce":280629682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6811","nonce":280629682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6815","nonce":280629682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":280629682},{"type":"v1","addr":"172.21.15.195:6813","nonce":280629682}]},"public_addr":"172.21.15.195:6809/280629682","cluster_addr":"172.21.15.195:6811/280629682","heartbeat_back_addr":"172.21.15.195:6815/280629682","heartbeat_front_addr":"172.21.15.195:6813/280629682","state":["exists","up"]},{"osd":6,"uuid":"22aa0cb6-96c3-4fc2-9b0f-ae0a8366ccf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6819","nonce":1789482351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6821","nonce":1789482351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6825","nonce":1789482351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1789482351},{"type":"v1","addr":"172.21.15.43:6823","nonce":1789482351}]},"public_addr":"172.21.15.43:6819/1789482351","cluster_addr":"172.21.15.43:6821/1789482351","heartbeat_back_addr":"172.21.15.43:6825/1789482351","heartbeat_front_addr":"172.21.15.43:6823/1789482351","state":["exists","up"]},{"osd":7,"uuid":"c07c9491-642a-420f-b45d-5626b7539d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6817","nonce":3123103723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6819","nonce":3123103723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6823","nonce":3123103723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":3123103723},{"type":"v1","addr":"172.21.15.112:6821","nonce":3123103723}]},"public_addr":"172.21.15.112:6817/3123103723","cluster_addr":"172.21.15.112:6819/3123103723","heartbeat_back_addr":"172.21.15.112:6823/3123103723","heartbeat_front_addr":"172.21.15.112:6821/3123103723","state":["exists","up"]},{"osd":8,"uuid":"105fc845-edce-449f-884a-2fa640a599f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6817","nonce":81594991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6819","nonce":81594991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6823","nonce":81594991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":81594991},{"type":"v1","addr":"172.21.15.195:6821","nonce":81594991}]},"public_addr":"172.21.15.195:6817/81594991","cluster_addr":"172.21.15.195:6819/81594991","heartbeat_back_addr":"172.21.15.195:6823/81594991","heartbeat_front_addr":"172.21.15.195:6821/81594991","state":["exists","up"]},{"osd":9,"uuid":"00f53017-0b8d-48a7-90cb-2b42a124b861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6827","nonce":309263897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6829","nonce":309263897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6833","nonce":309263897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":309263897},{"type":"v1","addr":"172.21.15.43:6831","nonce":309263897}]},"public_addr":"172.21.15.43:6827/309263897","cluster_addr":"172.21.15.43:6829/309263897","heartbeat_back_addr":"172.21.15.43:6833/309263897","heartbeat_front_addr":"172.21.15.43:6831/309263897","state":["exists","up"]},{"osd":10,"uuid":"fa850133-269d-405c-a1a2-64122432d80a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6825","nonce":3019340064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6827","nonce":3019340064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6831","nonce":3019340064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3019340064},{"type":"v1","addr":"172.21.15.112:6829","nonce":3019340064}]},"public_addr":"172.21.15.112:6825/3019340064","cluster_addr":"172.21.15.112:6827/3019340064","heartbeat_back_addr":"172.21.15.112:6831/3019340064","heartbeat_front_addr":"172.21.15.112:6829/3019340064","state":["exists","up"]},{"osd":11,"uuid":"4bd6ec99-ad60-42c8-82cb-bc2a3ed9e8a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6825","nonce":1436610024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6827","nonce":1436610024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6831","nonce":1436610024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":1436610024},{"type":"v1","addr":"172.21.15.195:6829","nonce":1436610024}]},"public_addr":"172.21.15.195:6825/1436610024","cluster_addr":"172.21.15.195:6827/1436610024","heartbeat_back_addr":"172.21.15.195:6831/1436610024","heartbeat_front_addr":"172.21.15.195:6829/1436610024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:40:40.683319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:04.426110+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:28.019599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:41:53.315098+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:18.134844+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:42:43.336964+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:10.089611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:43:35.186947+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:00.627772+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:27.409730+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:44:53.526262+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T20:45:20.276892+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":3,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:0/1916899701":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6800/3531160359":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/3360697116":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/1294774526":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/801305986":"2024-04-26T20:49:58.419352+0000","172.21.15.43:6801/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/1388340659":"2024-04-26T20:39:04.572932+0000","172.21.15.43:6800/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/1350680357":"2024-04-26T20:49:58.419352+0000","172.21.15.43:0/2986666548":"2024-04-26T20:38:37.272305+0000","172.21.15.43:6801/2222849100":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/544130458":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/3989115997":"2024-04-26T20:38:37.272305+0000","172.21.15.43:0/4191607377":"2024-04-26T20:39:04.572932+0000","172.21.15.43:0/2191695289":"2024-04-26T20:38:37.272305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 msgr2=0x7f2a8c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 0x7f2a8c0a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a94007900 tx=0x7f2a94008040 comp rx=0 tx=0).stop 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 msgr2=0x7f2aa019da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800b830 tx=0x7f2a98007b40 comp rx=0 tx=0).stop 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 shutdown_connections 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2a8c0a3db0 0x7f2a8c0a6270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aa0108a50 0x7f2aa019da20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aa0102a90 0x7f2aa0199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:51.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 --2- 172.21.15.43:0/3193855347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2aa0103450 0x7f2aa0199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.203+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 >> 172.21.15.43:0/3193855347 conn(0x7f2aa0079ba0 msgr2=0x7f2aa01016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.204+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 shutdown_connections 2024-04-25T21:00:51.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:51.204+0000 7f2aa75b5700 1 -- 172.21.15.43:0/3193855347 wait complete. 2024-04-25T21:00:51.892 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:51 smithi043 ceph-mon[29167]: pgmap v339: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:51.893 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:51 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/3193855347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:51.928 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs fail cephfs 2024-04-25T21:00:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:51 smithi195 ceph-mon[33250]: pgmap v339: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:52.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:51 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/3193855347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:51 smithi112 ceph-mon[32322]: pgmap v339: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 16 op/s 2024-04-25T21:00:52.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:51 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/3193855347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T21:00:52.186 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:53.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 -- 172.21.15.43:0/4175908562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2970101d20 msgr2=0x7f29701021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:53.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 --2- 172.21.15.43:0/4175908562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2970101d20 0x7f29701021a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2960009990 tx=0x7f2960009ca0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 -- 172.21.15.43:0/4175908562 shutdown_connections 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 --2- 172.21.15.43:0/4175908562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29701026e0 0x7f297010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 --2- 172.21.15.43:0/4175908562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970106990 0x7f2970106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 --2- 172.21.15.43:0/4175908562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2970101d20 0x7f29701021a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 -- 172.21.15.43:0/4175908562 >> 172.21.15.43:0/4175908562 conn(0x7f29700788f0 msgr2=0x7f2970078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 -- 172.21.15.43:0/4175908562 shutdown_connections 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.892+0000 7f2977b5f700 1 -- 172.21.15.43:0/4175908562 wait complete. 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 Processor -- start 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 -- start start 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 0x7f2970199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2970106990 0x7f297019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:53.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2970111c50 con 0x7f29701026e0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2970111ad0 con 0x7f2970101d20 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f2977b5f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2970111dd0 con 0x7f2970106990 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f29750fa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f29760fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2970106990 0x7f297019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f29750fa700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36068/0 (socket says 172.21.15.43:36068) 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f29750fa700 1 -- 172.21.15.43:0/2729571139 learned_addr learned my addr 172.21.15.43:0/2729571139 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.893+0000 7f29758fb700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 0x7f2970199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 -- 172.21.15.43:0/2729571139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2970106990 msgr2=0x7f297019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2970106990 0x7f297019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 -- 172.21.15.43:0/2729571139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 msgr2=0x7f2970199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 0x7f2970199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 -- 172.21.15.43:0/2729571139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297019e110 con 0x7f29701026e0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29758fb700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 0x7f2970199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f29750fa700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f29600057c0 tx=0x7f2960005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960026070 con 0x7f29701026e0 2024-04-25T21:00:53.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f296000b610 con 0x7f29701026e0 2024-04-25T21:00:53.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297019e3a0 con 0x7f29701026e0 2024-04-25T21:00:53.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29600173f0 con 0x7f29701026e0 2024-04-25T21:00:53.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.894+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29701a5c80 con 0x7f29701026e0 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.895+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2970103080 con 0x7f29701026e0 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.896+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2960029070 con 0x7f29701026e0 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.897+0000 7f2966ffd700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 0x7f295c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.897+0000 7f29758fb700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 0x7f295c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.897+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8513+0+0 (secure 0 0 0) 0x7f29600d1550 con 0x7f29701026e0 2024-04-25T21:00:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.898+0000 7f29758fb700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 0x7f295c0a6270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f296c009680 tx=0x7f296c009260 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:53.902+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f296005dff0 con 0x7f29701026e0 2024-04-25T21:00:54.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:53 smithi043 ceph-mon[29167]: pgmap v340: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:54.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:53 smithi195 ceph-mon[33250]: pgmap v340: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:54.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:53 smithi112 ceph-mon[32322]: pgmap v340: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-04-25T21:00:54.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.160+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f297002df80 con 0x7f29701026e0 2024-04-25T21:00:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.162+0000 7f2966ffd700 1 -- 172.21.15.43:0/2729571139 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7f2960013070 con 0x7f29701026e0 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.166+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 msgr2=0x7f295c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.166+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 0x7f295c0a6270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f296c009680 tx=0x7f296c009260 comp rx=0 tx=0).stop 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.166+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 msgr2=0x7f2970199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.166+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f29600057c0 tx=0x7f2960005ef0 comp rx=0 tx=0).stop 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 shutdown_connections 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f295c0a3db0 0x7f295c0a6270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2970106990 0x7f297019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2970101d20 0x7f2970199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:54.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 --2- 172.21.15.43:0/2729571139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29701026e0 0x7f2970199640 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 >> 172.21.15.43:0/2729571139 conn(0x7f29700788f0 msgr2=0x7f297006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 shutdown_connections 2024-04-25T21:00:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:54.167+0000 7f2977b5f700 1 -- 172.21.15.43:0/2729571139 wait complete. 2024-04-25T21:00:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T21:00:54.544 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a[29163]: 2024-04-25T21:00:54.161+0000 7f1b6e3cf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T21:00:54.544 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.544 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.544 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mds[71980]: -- 172.21.15.43:0/1179234955 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a65b53a40 con 0x558a65b26800 2024-04-25T21:00:54.545 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: starting mds.a at 2024-04-25T21:00:54.545 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.545 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.545 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mds[71543]: -- 172.21.15.43:0/3358181184 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635f757da40 con 0x5635f7550c00 2024-04-25T21:00:54.545 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: starting mds.g at 2024-04-25T21:00:54.591 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.591 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.591 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mds[63717]: -- 172.21.15.195:0/4226797420 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d81196ba40 con 0x55d81193f000 2024-04-25T21:00:54.591 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: starting mds.f at 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mds[64335]: -- 172.21.15.195:0/2478936329 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b9770fa40 con 0x560b976e2c00 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: starting mds.i at 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mds[63398]: -- 172.21.15.195:0/826711423 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f765965a40 con 0x55f765939000 2024-04-25T21:00:54.592 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: starting mds.l at 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c[64023]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c[64023]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mds[64027]: -- 172.21.15.195:0/3250244903 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f4427ba40 con 0x557f4424f000 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c[64023]: starting mds.c at 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.593 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: starting mds.b at 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mds[61675]: -- 172.21.15.112:0/248281011 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c1e407a40 con 0x564c1e3dac00 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: starting mds.k at 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e[61992]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e[61992]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.594 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e[61992]: starting mds.e at 2024-04-25T21:00:54.595 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h[62301]: ignoring --setuser ceph since I am not root 2024-04-25T21:00:54.595 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h[62301]: ignoring --setgroup ceph since I am not root 2024-04-25T21:00:54.595 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mds[62305]: -- 172.21.15.112:0/1247419998 <== mon.0 v2:172.21.15.43:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc2a8a5a40 con 0x55cc2a879000 2024-04-25T21:00:54.595 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h[62301]: starting mds.h at 2024-04-25T21:00:54.919 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T21:00:54.919 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T21:00:54.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T21:00:54.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T21:00:54.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: osdmap e103: 12 total, 12 up, 12 in 2024-04-25T21:00:54.920 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:54 smithi043 ceph-mon[29167]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-25T21:00:54.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T21:00:55.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: osdmap e103: 12 total, 12 up, 12 in 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:54 smithi195 ceph-mon[33250]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T21:00:55.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2729571139' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T21:00:55.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: osdmap e103: 12 total, 12 up, 12 in 2024-04-25T21:00:55.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:54 smithi112 ceph-mon[32322]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-25T21:00:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:56.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: pgmap v342: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6832/2969162615,v1:172.21.15.195:6835/2969162615] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6834/2140060625,v1:172.21.15.195:6838/2140060625] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6833/269335719,v1:172.21.15.195:6836/269335719] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6838/1251528942,v1:172.21.15.43:6839/1251528942] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.195:6837/3935094088,v1:172.21.15.195:6839/3935094088] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6832/4129274329,v1:172.21.15.112:6835/4129274329] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6834/1785091378,v1:172.21.15.112:6838/1785091378] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6833/1876104152,v1:172.21.15.112:6836/1876104152] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.112:6837/3492734812,v1:172.21.15.112:6839/3492734812] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: mds.? [v2:172.21.15.43:6840/936159014,v1:172.21.15.43:6841/936159014] up:boot 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T21:00:56.045 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T21:00:56.046 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:55 smithi043 ceph-mon[29167]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T21:00:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: pgmap v342: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6832/2969162615,v1:172.21.15.195:6835/2969162615] up:boot 2024-04-25T21:00:56.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6834/2140060625,v1:172.21.15.195:6838/2140060625] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6833/269335719,v1:172.21.15.195:6836/269335719] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6838/1251528942,v1:172.21.15.43:6839/1251528942] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.195:6837/3935094088,v1:172.21.15.195:6839/3935094088] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6832/4129274329,v1:172.21.15.112:6835/4129274329] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6834/1785091378,v1:172.21.15.112:6838/1785091378] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6833/1876104152,v1:172.21.15.112:6836/1876104152] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.112:6837/3492734812,v1:172.21.15.112:6839/3492734812] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: mds.? [v2:172.21.15.43:6840/936159014,v1:172.21.15.43:6841/936159014] up:boot 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T21:00:56.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:55 smithi195 ceph-mon[33250]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: pgmap v342: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6832/2969162615,v1:172.21.15.195:6835/2969162615] up:boot 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6834/2140060625,v1:172.21.15.195:6838/2140060625] up:boot 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6833/269335719,v1:172.21.15.195:6836/269335719] up:boot 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6838/1251528942,v1:172.21.15.43:6839/1251528942] up:boot 2024-04-25T21:00:56.093 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.195:6837/3935094088,v1:172.21.15.195:6839/3935094088] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6832/4129274329,v1:172.21.15.112:6835/4129274329] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6834/1785091378,v1:172.21.15.112:6838/1785091378] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6833/1876104152,v1:172.21.15.112:6836/1876104152] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.112:6837/3492734812,v1:172.21.15.112:6839/3492734812] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: mds.? [v2:172.21.15.43:6840/936159014,v1:172.21.15.43:6841/936159014] up:boot 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T21:00:56.094 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T21:00:56.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T21:00:56.095 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:55 smithi112 ceph-mon[32322]: from='mgr.24908 172.21.15.43:0/2334211520' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/1277980685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 msgr2=0x7fc6c406b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/1277980685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c406b670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009990 tx=0x7fc6b4009ca0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/1277980685 shutdown_connections 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/1277980685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/1277980685 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/1277980685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c406b670 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/1277980685 >> 172.21.15.43:0/1277980685 conn(0x7fc6c40789e0 msgr2=0x7fc6c4078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/1277980685 shutdown_connections 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.990+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/1277980685 wait complete. 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 Processor -- start 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 -- start start 2024-04-25T21:00:56.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c4101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112e40 con 0x7fc6c406b1f0 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112cc0 con 0x7fc6c4108a60 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6cc5d8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4112fc0 con 0x7fc6c406bbb0 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6ca374700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6ca374700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41606/0 (socket says 172.21.15.43:41606) 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6ca374700 1 -- 172.21.15.43:0/4255535853 learned_addr learned my addr 172.21.15.43:0/4255535853 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.991+0000 7fc6c9b73700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c4101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6cab75700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 -- 172.21.15.43:0/4255535853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 msgr2=0x7fc6c4101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c4101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 -- 172.21.15.43:0/4255535853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 msgr2=0x7fc6c4102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:56.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 -- 172.21.15.43:0/4255535853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c41a78b0 con 0x7fc6c406b1f0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6c9b73700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c4101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6cab75700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6ca374700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b530 tx=0x7fc6c000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0015020 con 0x7fc6c406b1f0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6c0011d00 con 0x7fc6c406b1f0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c41a7ba0 con 0x7fc6c406b1f0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0010e60 con 0x7fc6c406b1f0 2024-04-25T21:00:56.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.992+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41a80e0 con 0x7fc6c406b1f0 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.993+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c410b060 con 0x7fc6c406b1f0 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.994+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fc6c0018020 con 0x7fc6c406b1f0 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.995+0000 7fc6bb7fe700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 0x7fc6b00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.995+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8899+0+0 (secure 0 0 0) 0x7fc6c00d0090 con 0x7fc6c406b1f0 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.995+0000 7fc6c9b73700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 0x7fc6b00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:00:56.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:56.996+0000 7fc6c9b73700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 0x7fc6b00a6270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006010 tx=0x7fc6b400b540 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:00:57.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.000+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6c001f020 con 0x7fc6c406b1f0 2024-04-25T21:00:57.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.256+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6c410aa40 con 0x7fc6c406b1f0 2024-04-25T21:00:57.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.724+0000 7fc6bb7fe700 1 -- 172.21.15.43:0/4255535853 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) ==== 104+0+0 (secure 0 0 0) 0x7fc6c009c6a0 con 0x7fc6c406b1f0 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 msgr2=0x7fc6b00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 0x7fc6b00a6270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4006010 tx=0x7fc6b400b540 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 msgr2=0x7fc6c41019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b530 tx=0x7fc6c000b8f0 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 shutdown_connections 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7fc6b00a3db0 0x7fc6b00a6270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc6c4108a60 0x7fc6c4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406b1f0 0x7fc6c41019b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 --2- 172.21.15.43:0/4255535853 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc6c406bbb0 0x7fc6c4101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 >> 172.21.15.43:0/4255535853 conn(0x7fc6c40789e0 msgr2=0x7fc6c40ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 shutdown_connections 2024-04-25T21:00:57.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:00:57.727+0000 7fc6cc5d8700 1 -- 172.21.15.43:0/4255535853 wait complete. 2024-04-25T21:00:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:57 smithi043 ceph-mon[29167]: pgmap v343: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:58.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:57 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T21:00:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:57 smithi195 ceph-mon[33250]: pgmap v343: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:58.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:57 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T21:00:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:57 smithi112 ceph-mon[32322]: pgmap v343: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:00:58.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:57 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T21:00:58.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T21:00:58.696 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:00:59.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:58 smithi043 ceph-mon[29167]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T21:00:59.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:58 smithi043 ceph-mon[29167]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T21:00:59.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:58 smithi043 ceph-mon[29167]: Cluster is now healthy 2024-04-25T21:00:59.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:58 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T21:00:59.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:58 smithi043 ceph-mon[29167]: fsmap 12 up:standby 2024-04-25T21:00:59.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:58 smithi195 ceph-mon[33250]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:58 smithi195 ceph-mon[33250]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:58 smithi195 ceph-mon[33250]: Cluster is now healthy 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:58 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:58 smithi195 ceph-mon[33250]: fsmap 12 up:standby 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:58 smithi112 ceph-mon[32322]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:58 smithi112 ceph-mon[32322]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:58 smithi112 ceph-mon[32322]: Cluster is now healthy 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:58 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/4255535853' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T21:00:59.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:58 smithi112 ceph-mon[32322]: fsmap 12 up:standby 2024-04-25T21:01:00.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:00:59 smithi043 ceph-mon[29167]: pgmap v344: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:01:00.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:00:59 smithi195 ceph-mon[33250]: pgmap v344: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:01:00.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:00:59 smithi112 ceph-mon[32322]: pgmap v344: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-25T21:01:00.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 -- 172.21.15.43:0/2311818389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960102300 msgr2=0x7f996010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 --2- 172.21.15.43:0/2311818389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960102300 0x7f996010e7f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f995800b0a0 tx=0x7f995800b3b0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 -- 172.21.15.43:0/2311818389 shutdown_connections 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 --2- 172.21.15.43:0/2311818389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960107990 0x7f9960107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 --2- 172.21.15.43:0/2311818389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960102300 0x7f996010e7f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 --2- 172.21.15.43:0/2311818389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 0x7f9960101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 -- 172.21.15.43:0/2311818389 >> 172.21.15.43:0/2311818389 conn(0x7f99600788f0 msgr2=0x7f9960078d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 -- 172.21.15.43:0/2311818389 shutdown_connections 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.427+0000 7f996816e700 1 -- 172.21.15.43:0/2311818389 wait complete. 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 Processor -- start 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 -- start start 2024-04-25T21:01:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 0x7f9960199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960102300 0x7f9960199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9960111c70 con 0x7f9960107990 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9960111af0 con 0x7f9960101940 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996816e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9960111df0 con 0x7f9960102300 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996670b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996670b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41638/0 (socket says 172.21.15.43:41638) 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f996670b700 1 -- 172.21.15.43:0/2249360818 learned_addr learned my addr 172.21.15.43:0/2249360818 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.428+0000 7f9965709700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960102300 0x7f9960199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f9965f0a700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 0x7f9960199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 -- 172.21.15.43:0/2249360818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960102300 msgr2=0x7f9960199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960102300 0x7f9960199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 -- 172.21.15.43:0/2249360818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 msgr2=0x7f9960199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 0x7f9960199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 -- 172.21.15.43:0/2249360818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996019e0c0 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996670b700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f995800b830 tx=0x7f9958007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958021020 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996019e350 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f995801db40 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995801bb80 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.429+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99601a5c30 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.430+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9960069730 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.431+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9958024020 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.432+0000 7f9956ffd700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 0x7f994c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.432+0000 7f9965f0a700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 0x7f994c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.432+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8899+0+0 (secure 0 0 0) 0x7f99580d1df0 con 0x7f9960107990 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.433+0000 7f9965f0a700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 0x7f994c0a6270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f995c00abd0 tx=0x7f995c00a380 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:01:00.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.437+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f995802b020 con 0x7f9960107990 2024-04-25T21:01:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.643+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99601a5e00 con 0x7f9960107990 2024-04-25T21:01:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.732+0000 7f9956ffd700 1 -- 172.21.15.43:0/2249360818 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7f995809e340 con 0x7f9960107990 2024-04-25T21:01:00.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 msgr2=0x7f994c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 0x7f994c0a6270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f995c00abd0 tx=0x7f995c00a380 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 msgr2=0x7f996019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f995800b830 tx=0x7f9958007a90 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 shutdown_connections 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f994c0a3db0 0x7f994c0a6270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9960107990 0x7f996019d980 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9960101940 0x7f9960199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 --2- 172.21.15.43:0/2249360818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9960102300 0x7f9960199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 >> 172.21.15.43:0/2249360818 conn(0x7f99600788f0 msgr2=0x7f9960105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:01:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.735+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 shutdown_connections 2024-04-25T21:01:00.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:00.736+0000 7f996816e700 1 -- 172.21.15.43:0/2249360818 wait complete. 2024-04-25T21:01:00.737 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-04-25T21:01:01.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:00 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:01.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:00 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:01.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:00 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:01.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f shell --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T21:01:01.672 INFO:teuthology.orchestra.run.smithi043.stderr:Inferring config /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T21:01:01.927 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:01 smithi043 ceph-mon[29167]: pgmap v345: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T21:01:01.927 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:01 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:01.928 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:01 smithi043 ceph-mon[29167]: osdmap e104: 12 total, 12 up, 12 in 2024-04-25T21:01:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:01 smithi195 ceph-mon[33250]: pgmap v345: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T21:01:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:01 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:02.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:01 smithi195 ceph-mon[33250]: osdmap e104: 12 total, 12 up, 12 in 2024-04-25T21:01:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:01 smithi112 ceph-mon[32322]: pgmap v345: 97 pgs: 97 active+clean; 76 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-25T21:01:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:01 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/2249360818' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:02.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:01 smithi112 ceph-mon[32322]: osdmap e104: 12 total, 12 up, 12 in 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 -- 172.21.15.43:0/3043284865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04101400 msgr2=0x7f2b04101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/3043284865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04101400 0x7f2b04101880 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009990 tx=0x7f2af8009ca0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 -- 172.21.15.43:0/3043284865 shutdown_connections 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/3043284865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04107b20 0x7f2b04107f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/3043284865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101dc0 0x7f2b0410f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/3043284865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04101400 0x7f2b04101880 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 -- 172.21.15.43:0/3043284865 >> 172.21.15.43:0/3043284865 conn(0x7f2b04076c60 msgr2=0x7f2b04077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 -- 172.21.15.43:0/3043284865 shutdown_connections 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.397+0000 7f2b08c4f700 1 -- 172.21.15.43:0/3043284865 wait complete. 2024-04-25T21:01:03.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 Processor -- start 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 -- start start 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 0x7f2b041a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101dc0 0x7f2b041a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04112dd0 con 0x7f2b04107b20 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04112c50 con 0x7f2b04101400 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.398+0000 7f2b08c4f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04112f50 con 0x7f2b04101dc0 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41660/0 (socket says 172.21.15.43:41660) 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 -- 172.21.15.43:0/1466252950 learned_addr learned my addr 172.21.15.43:0/1466252950 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b01d9b700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101dc0 0x7f2b041a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b0259c700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 0x7f2b041a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 -- 172.21.15.43:0/1466252950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101dc0 msgr2=0x7f2b041a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101dc0 0x7f2b041a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 -- 172.21.15.43:0/1466252950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 msgr2=0x7f2b041a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 0x7f2b041a53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 -- 172.21.15.43:0/1466252950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0410f090 con 0x7f2b04107b20 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b0259c700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 0x7f2b041a53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b02d9d700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007d70 tx=0x7f2afc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc016020 con 0x7f2b04107b20 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2afc00ad40 con 0x7f2b04107b20 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0410f380 con 0x7f2b04107b20 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0116f0 con 0x7f2b04107b20 2024-04-25T21:01:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.399+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b041ac230 con 0x7f2b04107b20 2024-04-25T21:01:03.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.400+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b04069730 con 0x7f2b04107b20 2024-04-25T21:01:03.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.402+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2afc019020 con 0x7f2b04107b20 2024-04-25T21:01:03.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.402+0000 7f2af37fe700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 0x7f2aec0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T21:01:03.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.403+0000 7f2b0259c700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 0x7f2aec0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T21:01:03.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.403+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8403+0+0 (secure 0 0 0) 0x7f2afc0d0ab0 con 0x7f2b04107b20 2024-04-25T21:01:03.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.403+0000 7f2b0259c700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 0x7f2aec0a6270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2af4005950 tx=0x7f2af40058e0 comp rx=0 tx=0).ready entity=mgr.24908 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T21:01:03.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.406+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2afc020020 con 0x7f2b04107b20 2024-04-25T21:01:03.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.612+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b041ac5b0 con 0x7f2b04107b20 2024-04-25T21:01:03.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.736+0000 7f2af37fe700 1 -- 172.21.15.43:0/1466252950 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7f2afc09d2d0 con 0x7f2b04107b20 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 msgr2=0x7f2aec0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 0x7f2aec0a6270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2af4005950 tx=0x7f2af40058e0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 msgr2=0x7f2b0410e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007d70 tx=0x7f2afc00a340 comp rx=0 tx=0).stop 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 shutdown_connections 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:6800/1773585199,v1:172.21.15.43:6801/1773585199] conn(0x7f2aec0a3db0 0x7f2aec0a6270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b04107b20 0x7f2b0410e8c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2b04101400 0x7f2b041a53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 --2- 172.21.15.43:0/1466252950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b04101dc0 0x7f2b041a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T21:01:03.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.740+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 >> 172.21.15.43:0/1466252950 conn(0x7f2b04076c60 msgr2=0x7f2b040ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T21:01:03.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.741+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 shutdown_connections 2024-04-25T21:01:03.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-25T21:01:03.741+0000 7f2b08c4f700 1 -- 172.21.15.43:0/1466252950 wait complete. 2024-04-25T21:01:03.743 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-04-25T21:01:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:03 smithi043 ceph-mon[29167]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T21:01:04.044 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:03 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:03 smithi195 ceph-mon[33250]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T21:01:04.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:03 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:03 smithi112 ceph-mon[32322]: pgmap v347: 65 pgs: 65 active+clean; 577 KiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T21:01:04.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:03 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T21:01:04.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:01:04.449 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:01:04.480 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:01:04.514 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T21:01:04.515 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T21:01:04.531 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T21:01:04.546 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T21:01:04.571 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T21:01:04.571 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-25T21:01:04.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a 2024-04-25T21:01:04.749 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 systemd[1]: Stopping Ceph mon.a for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:04.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:04 smithi195 ceph-mon[33250]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:04.841 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:04 smithi195 ceph-mon[33250]: osdmap e105: 12 total, 12 up, 12 in 2024-04-25T21:01:05.019 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 ceph-mon[29167]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:05.019 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 ceph-mon[29167]: osdmap e105: 12 total, 12 up, 12 in 2024-04-25T21:01:05.019 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a[29163]: 2024-04-25T21:01:04.909+0000 7f1b73bda700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:05.020 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a[29163]: 2024-04-25T21:01:04.909+0000 7f1b73bda700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T21:01:05.020 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:04 smithi043 podman[98161]: 2024-04-25 21:01:04.991542959 +0000 UTC m=+0.212931039 container stop 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux ) 2024-04-25T21:01:05.020 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:05 smithi043 podman[98161]: 2024-04-25 21:01:05.019756632 +0000 UTC m=+0.241144712 container died 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T21:01:05.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:04 smithi112 ceph-mon[32322]: from='client.? 172.21.15.43:0/1466252950' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T21:01:05.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:04 smithi112 ceph-mon[32322]: osdmap e105: 12 total, 12 up, 12 in 2024-04-25T21:01:05.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:05 smithi043 podman[98161]: 2024-04-25 21:01:05.443978439 +0000 UTC m=+0.665366518 container cleanup 994f944184b039e5ff73e43aeac0f4855cf25b5001452e87c871a884388744ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2) 2024-04-25T21:01:05.653 INFO:journalctl@ceph.mon.a.smithi043.stdout:Apr 25 21:01:05 smithi043 bash[98161]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-a 2024-04-25T21:01:05.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.a.service' 2024-04-25T21:01:05.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:05.922 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-25T21:01:05.922 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-25T21:01:05.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.b 2024-04-25T21:01:06.228 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:05 smithi112 systemd[1]: Stopping Ceph mon.b for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:06.493 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b[32318]: 2024-04-25T21:01:06.227+0000 7ffbb8358700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:06.493 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b[32318]: 2024-04-25T21:01:06.227+0000 7ffbb8358700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-25T21:01:06.779 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:06 smithi112 podman[68847]: 2024-04-25 21:01:06.493243352 +0000 UTC m=+0.379821386 container died a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T21:01:07.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:06 smithi112 podman[68847]: 2024-04-25 21:01:06.978418499 +0000 UTC m=+0.864996533 container cleanup a8e97efb7e0696fd3a6908a0b8e79d4ac8153d2b9ceb7facc31ad1ee6217f3ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T21:01:07.092 INFO:journalctl@ceph.mon.b.smithi112.stdout:Apr 25 21:01:06 smithi112 bash[68847]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-b 2024-04-25T21:01:07.340 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.b.service' 2024-04-25T21:01:07.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:07.387 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-25T21:01:07.387 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-25T21:01:07.387 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.c 2024-04-25T21:01:07.701 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:07 smithi195 systemd[1]: Stopping Ceph mon.c for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c[33242]: 2024-04-25T21:01:07.701+0000 7f070c98f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c[33242]: 2024-04-25T21:01:07.701+0000 7f070c98f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T21:01:08.091 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:07 smithi195 podman[70464]: 2024-04-25 21:01:07.915855528 +0000 UTC m=+0.336234664 container died e15bcc0fad98e3a15072ee813b060c9b9d54d2ccd82ca2ba54558bac8cb63f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-04-25T21:01:08.562 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 podman[70464]: 2024-04-25 21:01:08.327206543 +0000 UTC m=+0.747585687 container cleanup e15bcc0fad98e3a15072ee813b060c9b9d54d2ccd82ca2ba54558bac8cb63f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:08.562 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 bash[70464]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c 2024-04-25T21:01:08.800 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.c.service' 2024-04-25T21:01:08.822 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 podman[70477]: 2024-04-25 21:01:08.562414442 +0000 UTC m=+0.643005091 container remove e15bcc0fad98e3a15072ee813b060c9b9d54d2ccd82ca2ba54558bac8cb63f7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mon-c, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T21:01:08.822 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.c.service: Deactivated successfully. 2024-04-25T21:01:08.822 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 systemd[1]: Stopped Ceph mon.c for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T21:01:08.822 INFO:journalctl@ceph.mon.c.smithi195.stdout:Apr 25 21:01:08 smithi195 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mon.c.service: Consumed 12.134s CPU time. 2024-04-25T21:01:08.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:08.856 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-25T21:01:08.856 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-25T21:01:08.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x 2024-04-25T21:01:09.227 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 21:01:08 smithi043 systemd[1]: Stopping Ceph mgr.x for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:09.508 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 21:01:09 smithi043 podman[98282]: 2024-04-25 21:01:09.229814251 +0000 UTC m=+0.175250676 container died 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:09.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 21:01:09 smithi043 podman[98282]: 2024-04-25 21:01:09.608069028 +0000 UTC m=+0.553505478 container cleanup 229870cb9d8611b992fd03d5e2403407ebbef66b806a3a1658e2e2fccd50eaa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d69f13d827952bb07bb9b7973bca14f97d764d6f, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T21:01:09.794 INFO:journalctl@ceph.mgr.x.smithi043.stdout:Apr 25 21:01:09 smithi043 bash[98282]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-x 2024-04-25T21:01:10.198 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-25T21:01:10.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:10.233 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-25T21:01:10.233 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-25T21:01:10.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.y 2024-04-25T21:01:10.578 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 21:01:10 smithi112 systemd[1]: Stopping Ceph mgr.y for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:10.842 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 21:01:10 smithi112 podman[68971]: 2024-04-25 21:01:10.579099107 +0000 UTC m=+0.154329129 container died 5f4c642dcf0f613b3641703915cac182742274400ab823770a8e80e269b9108b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-25T21:01:11.218 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 21:01:10 smithi112 podman[68971]: 2024-04-25 21:01:10.967300728 +0000 UTC m=+0.542530748 container cleanup 5f4c642dcf0f613b3641703915cac182742274400ab823770a8e80e269b9108b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-25T21:01:11.218 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Apr 25 21:01:10 smithi112 bash[68971]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-y 2024-04-25T21:01:11.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-25T21:01:11.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:11.413 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-25T21:01:11.413 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-25T21:01:11.413 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.z 2024-04-25T21:01:11.744 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 21:01:11 smithi195 systemd[1]: Stopping Ceph mgr.z for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:12.091 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 21:01:11 smithi195 podman[70586]: 2024-04-25 21:01:11.745118354 +0000 UTC m=+0.133969997 container died 905c6976b4722424e02091ad46281dd21ff42e17b6da9e9e5169c1b18e14da3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:01:12.501 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 21:01:12 smithi195 podman[70586]: 2024-04-25 21:01:12.225108437 +0000 UTC m=+0.613960089 container cleanup 905c6976b4722424e02091ad46281dd21ff42e17b6da9e9e5169c1b18e14da3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-25T21:01:12.502 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Apr 25 21:01:12 smithi195 bash[70586]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mgr-z 2024-04-25T21:01:12.646 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-25T21:01:12.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:12.678 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-25T21:01:12.678 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T21:01:12.678 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.0 2024-04-25T21:01:13.004 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:12 smithi043 systemd[1]: Stopping Ceph osd.0 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:13.294 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0[44374]: 2024-04-25T21:01:13.004+0000 7f9813fc5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:13.294 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0[44374]: 2024-04-25T21:01:13.004+0000 7f9813fc5700 -1 osd.0 105 *** Got signal Terminated *** 2024-04-25T21:01:13.294 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0[44374]: 2024-04-25T21:01:13.004+0000 7f9813fc5700 -1 osd.0 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:18.848 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:18 smithi043 podman[98401]: 2024-04-25 21:01:18.558215731 +0000 UTC m=+5.685871023 container died ec56ab97302b43f4ce30f7dd130b590c6e1ae0ec3344af7ff37b98a634af850e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T21:01:19.222 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:18 smithi043 podman[98401]: 2024-04-25 21:01:18.938345672 +0000 UTC m=+6.066000956 container cleanup ec56ab97302b43f4ce30f7dd130b590c6e1ae0ec3344af7ff37b98a634af850e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T21:01:19.223 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:18 smithi043 bash[98401]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0 2024-04-25T21:01:19.544 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:19 smithi043 podman[98419]: 2024-04-25 21:01:19.223138891 +0000 UTC m=+0.657317793 container remove ec56ab97302b43f4ce30f7dd130b590c6e1ae0ec3344af7ff37b98a634af850e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T21:01:19.794 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:19 smithi043 podman[98515]: 2024-04-25 21:01:19.44727699 +0000 UTC m=+0.018791771 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:01:19.794 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:19 smithi043 podman[98515]: 2024-04-25 21:01:19.69967013 +0000 UTC m=+0.271184947 container create 00576c3831b408882fba15cd3bce4c252acf6a62ec0dd04dce1dec87d59795ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-04-25T21:01:20.271 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:19 smithi043 podman[98515]: 2024-04-25 21:01:19.960381703 +0000 UTC m=+0.531896475 container init 00576c3831b408882fba15cd3bce4c252acf6a62ec0dd04dce1dec87d59795ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5) 2024-04-25T21:01:20.271 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:19 smithi043 podman[98515]: 2024-04-25 21:01:19.963579272 +0000 UTC m=+0.535094047 container start 00576c3831b408882fba15cd3bce4c252acf6a62ec0dd04dce1dec87d59795ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:20.271 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:20 smithi043 podman[98515]: 2024-04-25 21:01:20.052261502 +0000 UTC m=+0.623776279 container attach 00576c3831b408882fba15cd3bce4c252acf6a62ec0dd04dce1dec87d59795ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-25T21:01:20.544 INFO:journalctl@ceph.osd.0.smithi043.stdout:Apr 25 21:01:20 smithi043 podman[98515]: 2024-04-25 21:01:20.271287859 +0000 UTC m=+0.842802630 container died 00576c3831b408882fba15cd3bce4c252acf6a62ec0dd04dce1dec87d59795ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS) 2024-04-25T21:01:20.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T21:01:20.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:20.970 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T21:01:20.970 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T21:01:20.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.1 2024-04-25T21:01:21.280 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:21 smithi112 systemd[1]: Stopping Ceph osd.1 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:21.544 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T21:01:21.279+0000 7f949c1d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:21.544 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T21:01:21.279+0000 7f949c1d7700 -1 osd.1 105 *** Got signal Terminated *** 2024-04-25T21:01:21.544 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1[36962]: 2024-04-25T21:01:21.279+0000 7f949c1d7700 -1 osd.1 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:26.923 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:26 smithi112 podman[69094]: 2024-04-25 21:01:26.650310297 +0000 UTC m=+5.492397937 container died 3e49472263a19f79dcadfc64d431f49508838bed01dda4c6ffe588a1982a3e00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T21:01:27.324 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69094]: 2024-04-25 21:01:27.013863174 +0000 UTC m=+5.855950827 container cleanup 3e49472263a19f79dcadfc64d431f49508838bed01dda4c6ffe588a1982a3e00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T21:01:27.324 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 bash[69094]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1 2024-04-25T21:01:27.592 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69124]: 2024-04-25 21:01:27.32402499 +0000 UTC m=+0.671361455 container remove 3e49472263a19f79dcadfc64d431f49508838bed01dda4c6ffe588a1982a3e00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416) 2024-04-25T21:01:27.910 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69215]: 2024-04-25 21:01:27.540938139 +0000 UTC m=+0.017826807 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:01:27.910 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69215]: 2024-04-25 21:01:27.649930131 +0000 UTC m=+0.126818780 container create 943aaea4e6004adf67ee0df69d93e539ff25ad805ed229743d775490d259ac55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T21:01:27.910 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69215]: 2024-04-25 21:01:27.91088271 +0000 UTC m=+0.387771360 container init 943aaea4e6004adf67ee0df69d93e539ff25ad805ed229743d775490d259ac55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T21:01:28.210 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:27 smithi112 podman[69215]: 2024-04-25 21:01:27.91401623 +0000 UTC m=+0.390904887 container start 943aaea4e6004adf67ee0df69d93e539ff25ad805ed229743d775490d259ac55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T21:01:28.210 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:28 smithi112 podman[69215]: 2024-04-25 21:01:28.019451161 +0000 UTC m=+0.496339826 container attach 943aaea4e6004adf67ee0df69d93e539ff25ad805ed229743d775490d259ac55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-25T21:01:28.522 INFO:journalctl@ceph.osd.1.smithi112.stdout:Apr 25 21:01:28 smithi112 podman[69215]: 2024-04-25 21:01:28.209983296 +0000 UTC m=+0.686871962 container died 943aaea4e6004adf67ee0df69d93e539ff25ad805ed229743d775490d259ac55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:28.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T21:01:28.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:28.899 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T21:01:28.899 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T21:01:28.899 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.2 2024-04-25T21:01:29.341 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:28 smithi195 systemd[1]: Stopping Ceph osd.2 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:29.842 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T21:01:29.370+0000 7f57bce75700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:29.842 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T21:01:29.370+0000 7f57bce75700 -1 osd.2 105 *** Got signal Terminated *** 2024-04-25T21:01:29.842 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2[38433]: 2024-04-25T21:01:29.370+0000 7f57bce75700 -1 osd.2 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:35.080 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:34 smithi195 podman[70712]: 2024-04-25 21:01:34.790559518 +0000 UTC m=+5.704122680 container died 4379b1ab265a4865aaae5f65de5117359918010721d475c7aa638d6660dd91ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-25T21:01:35.341 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:35 smithi195 podman[70712]: 2024-04-25 21:01:35.171582559 +0000 UTC m=+6.085145712 container cleanup 4379b1ab265a4865aaae5f65de5117359918010721d475c7aa638d6660dd91ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:35.341 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:35 smithi195 bash[70712]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2 2024-04-25T21:01:35.792 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:35 smithi195 podman[70741]: 2024-04-25 21:01:35.439889973 +0000 UTC m=+0.644266904 container remove 4379b1ab265a4865aaae5f65de5117359918010721d475c7aa638d6660dd91ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T21:01:36.051 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:35 smithi195 podman[70834]: 2024-04-25 21:01:35.695726041 +0000 UTC m=+0.017794314 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:01:36.051 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:35 smithi195 podman[70834]: 2024-04-25 21:01:35.807469015 +0000 UTC m=+0.129537322 container create bd1435829580d0aa1d84a28e1f8dc1d1f3e4cba8f9758114a25693a70a0b3382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:36.051 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:36 smithi195 podman[70834]: 2024-04-25 21:01:36.051813752 +0000 UTC m=+0.373882018 container init bd1435829580d0aa1d84a28e1f8dc1d1f3e4cba8f9758114a25693a70a0b3382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:36.341 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:36 smithi195 podman[70834]: 2024-04-25 21:01:36.055071545 +0000 UTC m=+0.377139812 container start bd1435829580d0aa1d84a28e1f8dc1d1f3e4cba8f9758114a25693a70a0b3382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:36.341 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:36 smithi195 podman[70834]: 2024-04-25 21:01:36.151993219 +0000 UTC m=+0.474061484 container attach bd1435829580d0aa1d84a28e1f8dc1d1f3e4cba8f9758114a25693a70a0b3382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:36.722 INFO:journalctl@ceph.osd.2.smithi195.stdout:Apr 25 21:01:36 smithi195 podman[70834]: 2024-04-25 21:01:36.352557022 +0000 UTC m=+0.674625282 container died bd1435829580d0aa1d84a28e1f8dc1d1f3e4cba8f9758114a25693a70a0b3382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5) 2024-04-25T21:01:37.033 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T21:01:37.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:37.073 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T21:01:37.073 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T21:01:37.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.3 2024-04-25T21:01:37.417 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:37 smithi043 systemd[1]: Stopping Ceph osd.3 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:37.794 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:37 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:37.417+0000 7f0bf9788700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:37.794 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:37 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:37.417+0000 7f0bf9788700 -1 osd.3 105 *** Got signal Terminated *** 2024-04-25T21:01:37.794 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:37 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:37.417+0000 7f0bf9788700 -1 osd.3 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:40.044 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:39 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:39.579+0000 7f0bf1d74700 -1 osd.3 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.041148+0000 front 2024-04-25T21:01:17.041128+0000 (oldest deadline 2024-04-25T21:01:38.642142+0000) 2024-04-25T21:01:40.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:39.932+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:41.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:40 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:40.682+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:41.044 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:40 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:40.546+0000 7f0bf1d74700 -1 osd.3 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.041148+0000 front 2024-04-25T21:01:17.041128+0000 (oldest deadline 2024-04-25T21:01:38.642142+0000) 2024-04-25T21:01:41.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:40 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:40.713+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:41.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:40.977+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:41.794 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:41 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:41.636+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:41.795 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:41 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3[51036]: 2024-04-25T21:01:41.543+0000 7f0bf1d74700 -1 osd.3 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.041148+0000 front 2024-04-25T21:01:17.041128+0000 (oldest deadline 2024-04-25T21:01:38.642142+0000) 2024-04-25T21:01:42.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:41 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:41.757+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:42.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:41.986+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:42.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:42.581+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:42.945 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:42 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:42.638+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:43.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:42 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:42.737+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:43.218 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:42 smithi043 podman[98638]: 2024-04-25 21:01:42.94515703 +0000 UTC m=+5.672741085 container died 7d5f23be0e5ef01335b9355207dd7d6be03d667a1b9c97066f49a8dc4056c2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-04-25T21:01:43.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:42.974+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:43.544 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:43 smithi043 podman[98638]: 2024-04-25 21:01:43.317509877 +0000 UTC m=+6.045093938 container cleanup 7d5f23be0e5ef01335b9355207dd7d6be03d667a1b9c97066f49a8dc4056c2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:01:43.544 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:43 smithi043 bash[98638]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3 2024-04-25T21:01:43.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:43.556+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:43.947 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:43 smithi043 podman[98657]: 2024-04-25 21:01:43.602283759 +0000 UTC m=+0.656285413 container remove 7d5f23be0e5ef01335b9355207dd7d6be03d667a1b9c97066f49a8dc4056c2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T21:01:43.947 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:43 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:43.669+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:44.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:43 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:43.706+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:44.255 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:43 smithi043 podman[98747]: 2024-04-25 21:01:43.850372698 +0000 UTC m=+0.018449656 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:01:44.255 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:43 smithi043 podman[98747]: 2024-04-25 21:01:43.97807629 +0000 UTC m=+0.146153233 container create 59c50b04cb4412bdbf0791e1c3a2c698fd2d99450f231f2a35cac976cc743271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T21:01:44.256 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:44 smithi043 podman[98747]: 2024-04-25 21:01:44.255878405 +0000 UTC m=+0.423955348 container init 59c50b04cb4412bdbf0791e1c3a2c698fd2d99450f231f2a35cac976cc743271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T21:01:44.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:43.980+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:44.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:44 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:44.326+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:44.544 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:44 smithi043 podman[98747]: 2024-04-25 21:01:44.259367247 +0000 UTC m=+0.427444191 container start 59c50b04cb4412bdbf0791e1c3a2c698fd2d99450f231f2a35cac976cc743271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416) 2024-04-25T21:01:44.544 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:44 smithi043 podman[98747]: 2024-04-25 21:01:44.355968394 +0000 UTC m=+0.524045346 container attach 59c50b04cb4412bdbf0791e1c3a2c698fd2d99450f231f2a35cac976cc743271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T21:01:44.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:44.525+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:44.875 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:44 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:44.695+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:44.875 INFO:journalctl@ceph.osd.3.smithi043.stdout:Apr 25 21:01:44 smithi043 podman[98747]: 2024-04-25 21:01:44.570803829 +0000 UTC m=+0.738880764 container died 59c50b04cb4412bdbf0791e1c3a2c698fd2d99450f231f2a35cac976cc743271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:01:45.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:44 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:44.724+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:45.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T21:01:45.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:45.246 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T21:01:45.246 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T21:01:45.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.4 2024-04-25T21:01:45.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:45.030+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:45.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:45 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:45.282+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:45.592 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:45 smithi112 systemd[1]: Stopping Ceph osd.4 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:45.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:45.531+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:46.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:45 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:45.732+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:46.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:45 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:45.759+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:46.092 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:45 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T21:01:45.685+0000 7f1d628cc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:46.092 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:45 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T21:01:45.685+0000 7f1d628cc700 -1 osd.4 105 *** Got signal Terminated *** 2024-04-25T21:01:46.092 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:45 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T21:01:45.685+0000 7f1d628cc700 -1 osd.4 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:46.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:46.059+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:46.770 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:46 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:46.304+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:46.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:46.575+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:47.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:46 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:46.769+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:47.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:46 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:46.711+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:47.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:47 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:47.258+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:47.556 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:47.106+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:47.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:47.556+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:48.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:47 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:47.788+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:48.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:47 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:47.677+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:48.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:48 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:48.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:48.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:48 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:48.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:48.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:48 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:48.040+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:48.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:48 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:48.236+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:48.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:48 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:48.236+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:48.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:48 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:48.517+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:48.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:48 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:48.517+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:49.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:48 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:48.711+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:49.278 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:48 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:48.826+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:49.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:49.005+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:49.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:49.109+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:49.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:49.109+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:49.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:49 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:49.277+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:49.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:49 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:49.277+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:49.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:49.549+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:49.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:49.549+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:49.842 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:49 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T21:01:49.439+0000 7f1d5eec0700 -1 osd.4 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.305417+0000 front 2024-04-25T21:01:25.305440+0000 (oldest deadline 2024-04-25T21:01:48.805570+0000) 2024-04-25T21:01:49.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:49 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:49.677+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:49.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:49 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:49.677+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:50.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:49 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:49.792+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:50.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:49 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:49.959+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:50.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:50 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:50.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:50.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:50 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:50.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:50.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:50 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:50.243+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:50.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:50 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:50.243+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:50.643 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:50 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4[43779]: 2024-04-25T21:01:50.393+0000 7f1d5eec0700 -1 osd.4 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.305417+0000 front 2024-04-25T21:01:25.305440+0000 (oldest deadline 2024-04-25T21:01:48.805570+0000) 2024-04-25T21:01:50.643 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:50 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:50.385+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:50.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:50 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:50.513+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:50.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:50 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:50.513+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:51.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:50 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:50.642+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:51.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:50 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:50.642+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:51.266 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:50 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:50.807+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:51.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:50 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:50.994+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:51.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:51.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:51.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:51.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:51.512 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:51.365+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:51.512 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:51 smithi112 podman[69319]: 2024-04-25 21:01:51.189746821 +0000 UTC m=+5.755440060 container died cfc1f18d4f3ce06614f520164157e75708a81e83b27b3b3dcd785ecb34418145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T21:01:51.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:51.265+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:51.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:51.265+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:51.829 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:51 smithi112 podman[69319]: 2024-04-25 21:01:51.603346381 +0000 UTC m=+6.169039628 container cleanup cfc1f18d4f3ce06614f520164157e75708a81e83b27b3b3dcd785ecb34418145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-25T21:01:51.830 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:51 smithi112 bash[69319]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4 2024-04-25T21:01:51.830 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:51.620+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:51.830 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:51 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:51.620+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:51.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:51.487+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:51.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:51 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:51.487+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:52.092 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:51 smithi112 podman[69336]: 2024-04-25 21:01:51.829901624 +0000 UTC m=+0.634685825 container remove cfc1f18d4f3ce06614f520164157e75708a81e83b27b3b3dcd785ecb34418145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:52.218 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:51.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:52.218 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:51 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:51.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:52.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:52.035+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:52.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:52.223+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:52.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:52.223+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:52.525 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:52 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:52.393+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:52.525 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.174113788 +0000 UTC m=+0.017914353 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:01:52.525 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.297463178 +0000 UTC m=+0.141263727 container create e657e6f573adc1a7baaad1002df695409198b8aea6d7d4129b821d5ae8fffa25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:01:52.525 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.525579135 +0000 UTC m=+0.369379684 container init e657e6f573adc1a7baaad1002df695409198b8aea6d7d4129b821d5ae8fffa25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T21:01:52.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:52 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:52.217+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:52.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:52 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:52.217+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:52.814 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:52 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:52.624+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:52.814 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:52 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:52.624+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:52.815 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.52878845 +0000 UTC m=+0.372589003 container start e657e6f573adc1a7baaad1002df695409198b8aea6d7d4129b821d5ae8fffa25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T21:01:52.815 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.617197377 +0000 UTC m=+0.460997944 container attach e657e6f573adc1a7baaad1002df695409198b8aea6d7d4129b821d5ae8fffa25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T21:01:52.815 INFO:journalctl@ceph.osd.4.smithi112.stdout:Apr 25 21:01:52 smithi112 podman[69431]: 2024-04-25 21:01:52.814995737 +0000 UTC m=+0.658796290 container died e657e6f573adc1a7baaad1002df695409198b8aea6d7d4129b821d5ae8fffa25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T21:01:52.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:52.513+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:52.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:52 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:52.513+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:53.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:52 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:52.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:53.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:52 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:52.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:53.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:53.026+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:53.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:53.244+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:53.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:53.244+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:53.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T21:01:53.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:01:53.470 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T21:01:53.471 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T21:01:53.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.5 2024-04-25T21:01:53.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:53.215+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:53.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:53.215+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:53.683 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:53.414+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:53.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:53.618+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:53.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:53 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:53.618+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:53.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:53.502+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:53.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:53.502+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:53.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 systemd[1]: Stopping Ceph osd.5 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:01:54.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:53.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:54.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:53 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:53.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:54.241 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:54.016+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:54.241 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:53.951+0000 7fcd30f7b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:01:54.241 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:53.951+0000 7fcd30f7b700 -1 osd.5 105 *** Got signal Terminated *** 2024-04-25T21:01:54.241 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:53 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:53.951+0000 7fcd30f7b700 -1 osd.5 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:01:54.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:54.208+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:54.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:54.208+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:54.591 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:54.458+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:54.591 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:54.458+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:54.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:54.241+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:54.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:54 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:54.241+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:54.664 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:54.386+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:55.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:54.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:55.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:54 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:54.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:55.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:54.664+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:55.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:54 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:54.664+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:55.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:55.030+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:55.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:55.193+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:55.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:55.193+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:55.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:55.223+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:55.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:55.223+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:55.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:55.223+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:01:55.699 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:55.384+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:55.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:55.419+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:55.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:55.419+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:56.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:55.699+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:56.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:55 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:55.699+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:56.264 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:55.807+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:56.265 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:55.807+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:56.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:55 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:55.995+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:56.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:56.168+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:56.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:56.168+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:56.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:56.264+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:56.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:56.264+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:56.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:56.264+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:01:56.713 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:56.352+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:56.713 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:56.352+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:01:56.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:56.389+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:56.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:56 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:56.389+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:57.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:56.713+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:57.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:56.713+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:57.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:56 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:56.713+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:01:57.269 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:56.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:57.269 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:56.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:57.269 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:56 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:56.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:01:57.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:57.182+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:57.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:57.182+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:57.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:57.006+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:57.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:57.006+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:01:57.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:57.268+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:57.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:57.268+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:57.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:57.268+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:01:57.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:57.330+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:57.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:57.330+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:01:57.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:57.388+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:57.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:57.388+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:57.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:57 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:57.388+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.290670+0000 front 2024-04-25T21:01:33.290705+0000 (oldest deadline 2024-04-25T21:01:56.790774+0000) 2024-04-25T21:01:58.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:57.748+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:58.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:57.748+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:58.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:57 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:57.748+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:01:58.237 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:57.795+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:58.238 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:57.795+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:58.238 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:57 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:57.795+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:01:58.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:58.000+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:58.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:58.000+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:01:58.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:58.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:58.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:58.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:58.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:58.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:01:58.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:58.237+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:58.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:58.237+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:58.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:58.237+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:01:58.780 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:58 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:58.376+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:58.780 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:58 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:58.376+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:01:58.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:58.372+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.588391+0000 front 2024-04-25T21:01:17.588410+0000 (oldest deadline 2024-04-25T21:01:41.688470+0000) 2024-04-25T21:01:58.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:58.372+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:21.688920+0000 front 2024-04-25T21:01:21.689058+0000 (oldest deadline 2024-04-25T21:01:47.588958+0000) 2024-04-25T21:01:58.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:58 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5[44953]: 2024-04-25T21:01:58.372+0000 7fcd29567700 -1 osd.5 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.290670+0000 front 2024-04-25T21:01:33.290705+0000 (oldest deadline 2024-04-25T21:01:56.790774+0000) 2024-04-25T21:01:59.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:58 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:58.780+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:01:59.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:58 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:58.780+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:01:59.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:58 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:58.780+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:01:59.268 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:58.797+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:01:59.268 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:58.797+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:01:59.268 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:58 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:58.797+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:01:59.287 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:59.013+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:01:59.287 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:59.013+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:01:59.288 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:59.113+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:01:59.288 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:59.113+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:01:59.288 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:01:59.113+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:01:59.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:59.267+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:01:59.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:59.267+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:01:59.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:01:59.267+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:01:59.585 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:59 smithi195 podman[70939]: 2024-04-25 21:01:59.288070522 +0000 UTC m=+5.617618521 container died a4e2327ee8ad8b97b0911611c4160752f614a2a378232bc436b9f6175e7d8114 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:01:59.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:59 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:59.338+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:01:59.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:01:59 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:01:59.338+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:01:59.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:59 smithi195 podman[70939]: 2024-04-25 21:01:59.668111896 +0000 UTC m=+5.997659893 container cleanup a4e2327ee8ad8b97b0911611c4160752f614a2a378232bc436b9f6175e7d8114 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True) 2024-04-25T21:01:59.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:59 smithi195 bash[70939]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5 2024-04-25T21:02:00.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:59 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:59.784+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:00.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:59 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:59.784+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:00.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:01:59 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:01:59.784+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:00.275 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:59.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:00.284 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:59.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:00.284 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:01:59 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:01:59.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:01:59 smithi195 podman[70956]: 2024-04-25 21:01:59.927974762 +0000 UTC m=+0.643589689 container remove a4e2327ee8ad8b97b0911611c4160752f614a2a378232bc436b9f6175e7d8114 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:59.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:01:59 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:01:59.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:00 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:00.065+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:00 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:00.065+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:00.285 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:00 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:00.065+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:00.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:00.275+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:00.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:00.275+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:00.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:00.275+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:00.556 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.188126128 +0000 UTC m=+0.018058052 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:00.556 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.320512705 +0000 UTC m=+0.150444629 container create adc9f9cdb73e008147d0b3d81281ee84de6d6ea7065f29eef8036713347bc0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-25T21:02:00.556 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.556565699 +0000 UTC m=+0.386497624 container init adc9f9cdb73e008147d0b3d81281ee84de6d6ea7065f29eef8036713347bc0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True) 2024-04-25T21:02:00.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:00 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:00.289+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:00.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:00 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:00.289+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:00.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.559659821 +0000 UTC m=+0.389591746 container start adc9f9cdb73e008147d0b3d81281ee84de6d6ea7065f29eef8036713347bc0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T21:02:00.841 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.640000045 +0000 UTC m=+0.469931988 container attach adc9f9cdb73e008147d0b3d81281ee84de6d6ea7065f29eef8036713347bc0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T21:02:01.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:00.781+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:01.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:00.781+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:01.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:00.781+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:01.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:00 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:00.778+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:01.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:00 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:00.778+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:01.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:00 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:00.778+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.5.smithi195.stdout:Apr 25 21:02:00 smithi195 podman[71047]: 2024-04-25 21:02:00.852449541 +0000 UTC m=+0.682381467 container died adc9f9cdb73e008147d0b3d81281ee84de6d6ea7065f29eef8036713347bc0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:00 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:00.961+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:00 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:00.961+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:01.040+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:01.040+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:01.135 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:01.040+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:01.453 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T21:02:01.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:01.489 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T21:02:01.490 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-25T21:02:01.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.6 2024-04-25T21:02:01.515 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.276+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:01.515 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.276+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:01.515 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.276+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:01.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:01 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:01.282+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:01.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:01 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:01.282+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:01.787 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 systemd[1]: Stopping Ceph osd.6 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.785+0000 7fc7dd53c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.785+0000 7fc7dd53c700 -1 osd.6 105 *** Got signal Terminated *** 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:01.785+0000 7fc7dd53c700 -1 osd.6 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:01.796+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:01.796+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:02.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:01 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:01.796+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:02.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:01 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:01.786+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:02.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:01 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:01.786+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:02.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:01 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:01.786+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:02.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:01.986+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:02.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:01 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:01.986+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:02.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:02 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:02.086+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:02.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:02 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:02.086+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:02.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:02 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:02.086+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:02.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:02.263+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:02.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:02.263+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:02.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:02.263+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:02.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:02 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:02.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:02.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:02 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:02.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:03.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:02.754+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:03.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:02.754+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:03.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:02 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:02.754+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:03.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:02 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:02.785+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:03.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:02 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:02.785+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:03.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:02 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:02.785+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:03.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:02 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:02.980+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:03.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:02 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:02.980+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:03.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:03 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:03.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:03.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:03 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:03.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:03.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:03 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:03.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:03.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:03.269+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:03.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:03.269+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:03.793 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:03.312+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:03.793 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:03.312+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:03.793 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:03.312+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:04.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:03.792+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:04.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:03.792+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:04.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:03.792+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:04.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:03.769+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:04.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:03.769+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:04.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:03.769+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:04.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:03 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:03.769+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:04.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:03 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:03.948+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:04.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:03 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:03.948+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:04.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:04.057+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:04.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:04.057+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:04.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:04.057+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:04.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:04.254+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:04.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:04.254+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:04.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:04.321+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:04.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:04.321+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:04.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:04.321+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:04.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:04.321+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.291024+0000 front 2024-04-25T21:01:40.291047+0000 (oldest deadline 2024-04-25T21:02:03.791153+0000) 2024-04-25T21:02:05.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:04.812+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:05.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:04.812+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:05.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:04.812+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:05.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:04 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:04.812+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:05.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:04.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:05.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:04.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:05.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:04 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:04.827+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:04.918+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:04.918+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:04 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:04.918+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:05.089+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:05.089+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:05.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:05.089+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:05.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:05.291+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:05.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:05.291+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:05.786 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:05.318+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:05.786 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:05.318+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:05.786 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:05.318+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:05.786 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:05.318+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.291024+0000 front 2024-04-25T21:01:40.291047+0000 (oldest deadline 2024-04-25T21:02:03.791153+0000) 2024-04-25T21:02:06.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:05.785+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:06.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:05.785+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:06.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:05.785+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:06.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:05 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:05.785+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:06.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:05.773+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:06.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:05.773+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:06.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:05.773+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:06.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:05 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:05.773+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:06.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:05.880+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:06.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:05.880+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:06.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:05 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:05.880+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:06.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:06.085+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:06.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:06.085+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:06.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:06.085+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:06.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:06.314+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:06.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:06.314+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:06.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:06.314+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:06.781 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:06.319+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:17.587355+0000 front 2024-04-25T21:01:17.587382+0000 (oldest deadline 2024-04-25T21:01:43.487552+0000) 2024-04-25T21:02:06.781 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:06.319+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.488101+0000 front 2024-04-25T21:01:23.488263+0000 (oldest deadline 2024-04-25T21:01:48.188294+0000) 2024-04-25T21:02:06.781 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:06.319+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:33.489549+0000 front 2024-04-25T21:01:33.489505+0000 (oldest deadline 2024-04-25T21:01:55.189405+0000) 2024-04-25T21:02:06.781 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6[57620]: 2024-04-25T21:02:06.319+0000 7fc7d9b30700 -1 osd.6 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.291024+0000 front 2024-04-25T21:01:40.291047+0000 (oldest deadline 2024-04-25T21:02:03.791153+0000) 2024-04-25T21:02:07.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:06.780+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:07.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:06.780+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:07.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:06.780+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:07.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:06 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:06.780+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:07.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:06.822+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:07.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:06.823+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:07.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:06.823+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:07.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:06 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:06.823+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:07.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:06.917+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:07.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:06.917+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:07.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:06 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:06.917+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:07.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:07.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:07.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:07.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:07.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:07.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:07.505 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:07 smithi043 podman[98853]: 2024-04-25 21:02:07.233380675 +0000 UTC m=+5.551141201 container died 37c3977a2b19ecab869f7cd165fc575333307d731c3763b9c87dca897c6de58f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T21:02:07.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:07.283+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:07.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:07.283+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:07.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:07.283+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:07.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:07 smithi043 podman[98853]: 2024-04-25 21:02:07.603780701 +0000 UTC m=+5.921541230 container cleanup 37c3977a2b19ecab869f7cd165fc575333307d731c3763b9c87dca897c6de58f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-25T21:02:07.794 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:07 smithi043 bash[98853]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6 2024-04-25T21:02:08.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:07.774+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:08.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:07.774+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:08.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:07.774+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:08.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:07.774+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:08.232 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:07 smithi043 podman[98881]: 2024-04-25 21:02:07.888473384 +0000 UTC m=+0.658053445 container remove 37c3977a2b19ecab869f7cd165fc575333307d731c3763b9c87dca897c6de58f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-25T21:02:08.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:07 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:07.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:08.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:07 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:07.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:08.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:07 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:07.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:08.232 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:07 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:07.820+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:08.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:08.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:08.070+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:07.945+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:07.945+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:08.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:07 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:07.945+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:08.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.135452109 +0000 UTC m=+0.018542266 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:08.544 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.247657374 +0000 UTC m=+0.130747521 container create 260d6ee5ac57ed61d918577900ea2a12a829f904cb798160db04b53fe80cff18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T21:02:08.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:08.255+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:08.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:08.255+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:08.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:08.255+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:08 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:08.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:08 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:08.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:08 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:08.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:08 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:08.789+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.642170428 +0000 UTC m=+0.525260578 container init 260d6ee5ac57ed61d918577900ea2a12a829f904cb798160db04b53fe80cff18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.64544535 +0000 UTC m=+0.528535497 container start 260d6ee5ac57ed61d918577900ea2a12a829f904cb798160db04b53fe80cff18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:02:08.954 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.725501592 +0000 UTC m=+0.608591753 container attach 260d6ee5ac57ed61d918577900ea2a12a829f904cb798160db04b53fe80cff18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True) 2024-04-25T21:02:09.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:08.727+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:09.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:08.727+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:09.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:08.727+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:09.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:08 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:08.727+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:09.294 INFO:journalctl@ceph.osd.6.smithi043.stdout:Apr 25 21:02:08 smithi043 podman[98967]: 2024-04-25 21:02:08.954443272 +0000 UTC m=+0.837533425 container died 260d6ee5ac57ed61d918577900ea2a12a829f904cb798160db04b53fe80cff18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-04-25T21:02:09.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:08.981+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:09.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:08.981+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:09.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:08 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:08.981+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:09.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:09.046+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:09.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:09.046+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:09.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:09.046+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:09.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:09.266+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:09.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:09.266+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:09.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:09.266+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:09.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.6.service' 2024-04-25T21:02:09.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:09.769 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-25T21:02:09.769 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-25T21:02:09.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.7 2024-04-25T21:02:10.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:09 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:09.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:10.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:09 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:09.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:10.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:09 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:09.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:10.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:09 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:09.775+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:10.091 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:09 smithi112 systemd[1]: Stopping Ceph osd.7 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:10.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:09.741+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:10.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:09.741+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:10.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:09.741+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:10.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:09 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:09.741+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:10.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:09.959+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:10.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:09.959+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:10.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:09 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:09.959+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:10.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:10.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:10.072+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.091+0000 7fc6ebbf4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.091+0000 7fc6ebbf4700 -1 osd.7 105 *** Got signal Terminated *** 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.091+0000 7fc6ebbf4700 -1 osd.7 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.310+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.310+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:10.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:10.310+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:11.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:10.778+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:11.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:10.778+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:11.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:10.778+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:11.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:10 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:10.778+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:11.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:10.762+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:11.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:10.762+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:11.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:10.762+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:11.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:10 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:10.762+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:11.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:10.972+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:11.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:10.972+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:11.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:10 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:10.972+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:11.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:11.067+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:11.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:11.067+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:11.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:11.067+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:11.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:11.290+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:11.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:11.290+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:11.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:11.290+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:11.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:11.290+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.214976+0000 front 2024-04-25T21:01:50.214988+0000 (oldest deadline 2024-04-25T21:02:11.215675+0000) 2024-04-25T21:02:12.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:11.810+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:12.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:11.810+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:12.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:11.810+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:12.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:11.810+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:12.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:11 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:11.817+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:12.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:11 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:11.817+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:12.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:11 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:11.817+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:12.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:11 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:11.817+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:12.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:11 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:11.817+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:12.110+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:12.110+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:12.110+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:11.953+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:11.953+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:12.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:11 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:11.953+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:12.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:12.257+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:12.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:12.257+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:12.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:12.257+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:12.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:12.257+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.214976+0000 front 2024-04-25T21:01:50.214988+0000 (oldest deadline 2024-04-25T21:02:11.215675+0000) 2024-04-25T21:02:13.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:12.809+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:13.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:12.809+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:13.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:12.809+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:13.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:12 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:12.809+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:13.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:12 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:12.839+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:13.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:12 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:12.839+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:13.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:12 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:12.839+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:13.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:12 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:12.839+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:13.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:12 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:12.839+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:12.940+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:12.940+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:12 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:12.940+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:13.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:13.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:13.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:13.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:13.064+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:13.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:13.300+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:13.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:13.300+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:13.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:13.300+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:13.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:13.300+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.214976+0000 front 2024-04-25T21:01:50.214988+0000 (oldest deadline 2024-04-25T21:02:11.215675+0000) 2024-04-25T21:02:14.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:13.827+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:14.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:13.827+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:14.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:13.827+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:14.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:13 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:13.827+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:14.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:13.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:14.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:13.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:14.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:13.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:14.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:13.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:14.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:13 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:13.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:14.094+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:14.094+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:14.094+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:14.094+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:13.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:13.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:13.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:14.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:13 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:13.987+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:14.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:14.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:22.210490+0000 front 2024-04-25T21:01:22.210590+0000 (oldest deadline 2024-04-25T21:01:49.811236+0000) 2024-04-25T21:02:14.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:14.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:29.811713+0000 front 2024-04-25T21:01:29.811881+0000 (oldest deadline 2024-04-25T21:01:56.212361+0000) 2024-04-25T21:02:14.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:14.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:41.513632+0000 front 2024-04-25T21:01:41.513814+0000 (oldest deadline 2024-04-25T21:02:05.613555+0000) 2024-04-25T21:02:14.592 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7[50472]: 2024-04-25T21:02:14.312+0000 7fc6e41e0700 -1 osd.7 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.214976+0000 front 2024-04-25T21:01:50.214988+0000 (oldest deadline 2024-04-25T21:02:11.215675+0000) 2024-04-25T21:02:15.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:14 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:14.848+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:15.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:14 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:14.848+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:15.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:14 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:14.848+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:15.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:14 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:14.848+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:15.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:14 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:14.848+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:15.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:14.985+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:15.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:14.985+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:15.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:14.985+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:15.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:14 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:14.985+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:15.136+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:15.136+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:15.136+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:15.136+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:14.874+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:15.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:14.874+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:15.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:14.874+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:15.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:14 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:14.874+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:15.892 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:15 smithi112 podman[69549]: 2024-04-25 21:02:15.596112297 +0000 UTC m=+5.635697625 container died 3563cb9073333e1bc9f396d03b236e7082417828df0dbc598e26d9869e1c4e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T21:02:16.226 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:15 smithi112 podman[69549]: 2024-04-25 21:02:15.991761024 +0000 UTC m=+6.031346350 container cleanup 3563cb9073333e1bc9f396d03b236e7082417828df0dbc598e26d9869e1c4e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-25T21:02:16.226 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:15 smithi112 bash[69549]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7 2024-04-25T21:02:16.227 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:15.912+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:16.227 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:15.912+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:16.227 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:15.912+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:16.227 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:15.912+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:16.227 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:15.912+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:16.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:15 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:15.888+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:16.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:15 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:15.888+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:16.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:15 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:15.888+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:16.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:15 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:15.888+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:16.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:15 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:15.888+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:16.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:16.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:16.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:16.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:15.949+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:15.949+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:16.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:15.949+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:16.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:15 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:15.949+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:16.516 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69566]: 2024-04-25 21:02:16.226833542 +0000 UTC m=+0.625969494 container remove 3563cb9073333e1bc9f396d03b236e7082417828df0dbc598e26d9869e1c4e0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T21:02:16.838 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69656]: 2024-04-25 21:02:16.418920988 +0000 UTC m=+0.017033744 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:16.839 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69656]: 2024-04-25 21:02:16.544393869 +0000 UTC m=+0.142506603 container create 6bd86e86442703e2746900426766546a2543970935b2bbc5bf86dd3bb703906f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:02:16.839 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69656]: 2024-04-25 21:02:16.838984387 +0000 UTC m=+0.437097131 container init 6bd86e86442703e2746900426766546a2543970935b2bbc5bf86dd3bb703906f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69656]: 2024-04-25 21:02:16.842469755 +0000 UTC m=+0.440582494 container start 6bd86e86442703e2746900426766546a2543970935b2bbc5bf86dd3bb703906f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:16 smithi112 podman[69656]: 2024-04-25 21:02:16.930449816 +0000 UTC m=+0.528562558 container attach 6bd86e86442703e2746900426766546a2543970935b2bbc5bf86dd3bb703906f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:16 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:16.951+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:16 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:16.951+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:16 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:16.951+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:17.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:16 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:16.951+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:17.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:16 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:16.951+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:17.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:16.891+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:17.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:16.891+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:17.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:16.891+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:17.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:16.891+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:17.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:16 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:16.891+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:16.975+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:16.975+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:16.975+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:16 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:16.975+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:17.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:17.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:17.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:17.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:17.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:17.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:17.403 INFO:journalctl@ceph.osd.7.smithi112.stdout:Apr 25 21:02:17 smithi112 podman[69656]: 2024-04-25 21:02:17.138404617 +0000 UTC m=+0.736517358 container died 6bd86e86442703e2746900426766546a2543970935b2bbc5bf86dd3bb703906f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T21:02:17.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.7.service' 2024-04-25T21:02:17.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:17.861 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-25T21:02:17.861 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-25T21:02:17.861 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.8 2024-04-25T21:02:18.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:17.911+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:18.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:17.911+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:18.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:17.911+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:18.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:17.911+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:18.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:17 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:17.911+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:18.163 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:18.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:18.163 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:18.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:18.163 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:18.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:18.163 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:18.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:18.163 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:17 smithi195 systemd[1]: Stopping Ceph osd.8 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:18.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:17.955+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:18.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:17.955+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:18.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:17.955+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:18.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:17 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:17.955+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:18.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.162+0000 7f9ee7c6c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:18.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:17.874+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:18.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:17.874+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:18.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:17.874+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:18.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:17.874+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:18.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:17 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:17.874+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:18.591 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.162+0000 7f9ee7c6c700 -1 osd.8 105 *** Got signal Terminated *** 2024-04-25T21:02:18.591 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.162+0000 7f9ee7c6c700 -1 osd.8 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:19.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:18.870+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:19.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:18.870+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:19.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:18.870+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:19.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:18.870+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:19.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:18 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:18.870+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:19.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:19.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:19.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:19.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:19.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:19.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:19.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:19.154+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.994+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.994+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.994+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:18 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:18.994+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:18.916+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:19.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:18.916+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:19.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:18.916+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:19.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:18.916+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:19.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:18 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:18.916+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:20.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:19.894+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:20.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:19.894+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:20.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:19.894+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:20.044 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:19.894+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:20.045 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:19 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:19.894+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:20.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:19.966+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:20.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:19.966+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:20.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:19.966+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:20.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:19 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:19.966+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:20.145+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:20.145+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:20.145+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:20.145+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:19.915+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:19.915+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:20.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:19.915+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:20.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:19.915+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:20.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:19.915+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:21.243 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:20.887+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:21.244 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:20.887+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:21.244 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:20.887+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:21.244 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:20.887+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:21.244 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:20 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:20.887+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:21.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:20.908+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:21.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:20.908+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:21.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:20.908+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:21.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:20.908+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:21.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:20 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:20.908+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:21.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:20.920+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:21.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:20.920+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:21.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:20.920+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:21.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:20 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:20.920+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:21.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:21.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:21.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:21.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:21.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:21.119+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:22.164 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:21.907+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:22.165 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:21.907+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:22.165 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:21.907+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:22.165 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:21 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:21.907+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:22.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:21 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:21.909+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:22.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:21 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:21.869+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:22.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:22.163+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:22.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:22.163+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:22.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:22.163+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:22.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:22.163+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:22.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:22.163+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:23.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:22 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:22.903+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:23.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:22.901+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.604974+0000 front 2024-04-25T21:01:25.604843+0000 (oldest deadline 2024-04-25T21:01:47.304767+0000) 2024-04-25T21:02:23.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:22.901+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.907064+0000 front 2024-04-25T21:01:32.907114+0000 (oldest deadline 2024-04-25T21:01:56.407251+0000) 2024-04-25T21:02:23.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:22.901+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.810080+0000 front 2024-04-25T21:01:40.809978+0000 (oldest deadline 2024-04-25T21:02:04.310059+0000) 2024-04-25T21:02:23.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:22.901+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:50.211078+0000 front 2024-04-25T21:01:50.210985+0000 (oldest deadline 2024-04-25T21:02:13.710948+0000) 2024-04-25T21:02:23.341 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:22 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8[51935]: 2024-04-25T21:02:22.901+0000 7f9ee0258700 -1 osd.8 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:58.411886+0000 front 2024-04-25T21:01:58.411936+0000 (oldest deadline 2024-04-25T21:02:22.511918+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:23.149+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:23.149+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:23.149+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:23.149+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:23.149+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:23.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:23.346 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:23.346 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:23.346 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:23.346 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:23.346 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:22 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:22.908+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:23.930 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:23 smithi195 podman[71153]: 2024-04-25 21:02:23.678187714 +0000 UTC m=+5.622141546 container died f40174c48ccdf613e6a62231b4aaeb37c7b6b88469fdec15b4a9259fd4790483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T21:02:24.239 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71153]: 2024-04-25 21:02:24.02176618 +0000 UTC m=+5.965720017 container cleanup f40174c48ccdf613e6a62231b4aaeb37c7b6b88469fdec15b4a9259fd4790483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-25T21:02:24.239 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 bash[71153]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8 2024-04-25T21:02:24.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:24 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:24.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:24.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:24 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:24.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:24.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:24 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:24.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:24.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:24 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:24.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:24.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:24 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:24.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:24.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:23 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:23.857+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:24.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:23 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:23.893+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:24.591 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71170]: 2024-04-25 21:02:24.239918462 +0000 UTC m=+0.561060453 container remove f40174c48ccdf613e6a62231b4aaeb37c7b6b88469fdec15b4a9259fd4790483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-25T21:02:24.947 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71262]: 2024-04-25 21:02:24.547888801 +0000 UTC m=+0.018310971 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:24.948 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71262]: 2024-04-25 21:02:24.666170887 +0000 UTC m=+0.136593076 container create 9f7449feb5571d8f250ff89803c57c106088fe41d0f37d76e354ea9a7c7c1347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-25T21:02:24.948 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71262]: 2024-04-25 21:02:24.94833188 +0000 UTC m=+0.418754027 container init 9f7449feb5571d8f250ff89803c57c106088fe41d0f37d76e354ea9a7c7c1347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T21:02:25.239 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:24 smithi195 podman[71262]: 2024-04-25 21:02:24.951552549 +0000 UTC m=+0.421974700 container start 9f7449feb5571d8f250ff89803c57c106088fe41d0f37d76e354ea9a7c7c1347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:02:25.239 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:25 smithi195 podman[71262]: 2024-04-25 21:02:25.060913981 +0000 UTC m=+0.531336137 container attach 9f7449feb5571d8f250ff89803c57c106088fe41d0f37d76e354ea9a7c7c1347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:02:25.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:25 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:25.192+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:25.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:25 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:25.192+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:25.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:25 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:25.192+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:25.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:25 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:25.192+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:25.240 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:25 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:25.192+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:25.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:24 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:24.821+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:25.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:24 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:24.878+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:25.506 INFO:journalctl@ceph.osd.8.smithi195.stdout:Apr 25 21:02:25 smithi195 podman[71262]: 2024-04-25 21:02:25.240185174 +0000 UTC m=+0.710607324 container died 9f7449feb5571d8f250ff89803c57c106088fe41d0f37d76e354ea9a7c7c1347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-25T21:02:25.806 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.8.service' 2024-04-25T21:02:25.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:25.843 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-25T21:02:25.843 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-25T21:02:25.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.9 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:26.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:25 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:25.841+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:26.164 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:25.871+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:25 smithi043 systemd[1]: Stopping Ceph osd.9 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.164+0000 7fc78f184700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.164+0000 7fc78f184700 -1 osd.9 105 *** Got signal Terminated *** 2024-04-25T21:02:26.165 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.164+0000 7fc78f184700 -1 osd.9 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:26.448 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:26 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:26.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:26.448 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:26 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:26.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:26.448 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:26 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:26.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:26.448 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:26 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:26.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:26.448 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:26 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:26.191+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:27.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:26 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:26.801+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:27.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:26 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:26.852+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:27.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:27.201+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:27.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:27.201+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:27.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:27.201+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:27.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:27.201+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:27.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:27.201+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:28.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:27 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:27.826+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:28.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:27 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:27.869+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:28.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:28.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:28.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:28.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:28.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:28.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:28.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:28.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:28.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:28 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:28.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:29.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:28 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:28.836+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:29.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:29.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:29.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:29.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:29.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:29.295 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:28 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:28.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:29.492 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:29.492 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:29.493 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:29.493 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:29.493 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:29.493 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:29 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:29.208+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:30.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:29 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:29.828+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:30.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:29 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:29.857+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:30.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:30 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:30.183+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:31.195 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:13.394892+0000 front 2024-04-25T21:01:13.395193+0000 (oldest deadline 2024-04-25T21:01:39.795799+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:26.197546+0000 front 2024-04-25T21:01:26.197592+0000 (oldest deadline 2024-04-25T21:01:50.897570+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:30.898103+0000 front 2024-04-25T21:01:30.897981+0000 (oldest deadline 2024-04-25T21:01:56.197971+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.799407+0000 front 2024-04-25T21:01:40.799432+0000 (oldest deadline 2024-04-25T21:02:05.499616+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:47.200795+0000 front 2024-04-25T21:01:47.200776+0000 (oldest deadline 2024-04-25T21:02:11.201282+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.203152+0000 front 2024-04-25T21:01:55.203347+0000 (oldest deadline 2024-04-25T21:02:21.102952+0000) 2024-04-25T21:02:31.196 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:30 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9[64657]: 2024-04-25T21:02:30.856+0000 7fc78b778700 -1 osd.9 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:04.003845+0000 front 2024-04-25T21:02:04.003865+0000 (oldest deadline 2024-04-25T21:02:29.903888+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:31.298 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:31.299 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:30 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:30.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:31.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:31.228+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:32.014 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:31 smithi043 podman[99073]: 2024-04-25 21:02:31.648733978 +0000 UTC m=+5.600335414 container died db23c584a67719f1b365e4f6b9c6eee665d044a721818df5e228f61b1f134f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-25T21:02:32.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:32 smithi043 podman[99073]: 2024-04-25 21:02:32.114354567 +0000 UTC m=+6.065956044 container cleanup db23c584a67719f1b365e4f6b9c6eee665d044a721818df5e228f61b1f134f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T21:02:32.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:32 smithi043 bash[99073]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9 2024-04-25T21:02:32.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:32.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:32.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:32.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:32.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:32.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:32.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:31 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:31.905+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:32.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:32 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:32.237+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:32.756 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:32 smithi043 podman[99092]: 2024-04-25 21:02:32.306834285 +0000 UTC m=+0.652335739 container remove db23c584a67719f1b365e4f6b9c6eee665d044a721818df5e228f61b1f134f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T21:02:33.043 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:32 smithi043 podman[99184]: 2024-04-25 21:02:32.659912231 +0000 UTC m=+0.018690226 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:33.043 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:32 smithi043 podman[99184]: 2024-04-25 21:02:32.799571303 +0000 UTC m=+0.158349316 container create d4eb1f6fe7f1357d01a58a1f63d5e377498a20bdbce3620f935a1757eaff1b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-25T21:02:33.043 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:33 smithi043 podman[99184]: 2024-04-25 21:02:33.043497948 +0000 UTC m=+0.402275929 container init d4eb1f6fe7f1357d01a58a1f63d5e377498a20bdbce3620f935a1757eaff1b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2) 2024-04-25T21:02:33.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:33 smithi043 podman[99184]: 2024-04-25 21:02:33.046721461 +0000 UTC m=+0.405499434 container start d4eb1f6fe7f1357d01a58a1f63d5e377498a20bdbce3620f935a1757eaff1b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T21:02:33.294 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:33 smithi043 podman[99184]: 2024-04-25 21:02:33.151869964 +0000 UTC m=+0.510647950 container attach d4eb1f6fe7f1357d01a58a1f63d5e377498a20bdbce3620f935a1757eaff1b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9-deactivate, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:33.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:33.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:32 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:32.907+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:33.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:33 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:33.202+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:33.794 INFO:journalctl@ceph.osd.9.smithi043.stdout:Apr 25 21:02:33 smithi043 podman[99184]: 2024-04-25 21:02:33.35793244 +0000 UTC m=+0.716710422 container died d4eb1f6fe7f1357d01a58a1f63d5e377498a20bdbce3620f935a1757eaff1b35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD) 2024-04-25T21:02:34.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.9.service' 2024-04-25T21:02:34.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:34.165 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-25T21:02:34.165 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-25T21:02:34.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.10 2024-04-25T21:02:34.191 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:34.191 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:34.192 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:34.192 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:34.192 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:34.192 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:34.192 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:33 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:33.875+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:34.470 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 systemd[1]: Stopping Ceph osd.10 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:34.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:34 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:34.184+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:34.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.469+0000 7f2761346700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:34.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.469+0000 7f2761346700 -1 osd.10 105 *** Got signal Terminated *** 2024-04-25T21:02:34.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.469+0000 7f2761346700 -1 osd.10 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:35.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:35.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:35.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:35.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:35.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:35.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:35.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:34 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:34.883+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:35.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:35.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:35.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:35.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:35.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:35.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:35.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:36.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:36.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:35 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:35.837+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:36.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:36 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:36.178+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:37.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:37.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:37.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:37.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:37.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:37.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:37.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:36 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:36.843+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:37.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:37.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:37.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:37.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:37.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:37.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:37 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:37.130+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:38.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:38.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:38.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:38.092 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:38.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:38.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:38.093 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:37 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:37.831+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:38.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:38.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:38.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:38.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:38.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:38.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:38 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:38.112+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:39.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:14.811174+0000 front 2024-04-25T21:01:14.811262+0000 (oldest deadline 2024-04-25T21:01:40.711189+0000) 2024-04-25T21:02:39.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:25.412131+0000 front 2024-04-25T21:01:25.412162+0000 (oldest deadline 2024-04-25T21:01:49.412935+0000) 2024-04-25T21:02:39.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.313989+0000 front 2024-04-25T21:01:32.313877+0000 (oldest deadline 2024-04-25T21:01:56.314562+0000) 2024-04-25T21:02:39.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6814 osd.3 since back 2024-04-25T21:01:40.415911+0000 front 2024-04-25T21:01:40.415752+0000 (oldest deadline 2024-04-25T21:02:03.315731+0000) 2024-04-25T21:02:39.342 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:49.717135+0000 front 2024-04-25T21:01:49.717087+0000 (oldest deadline 2024-04-25T21:02:15.617182+0000) 2024-04-25T21:02:39.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:55.617749+0000 front 2024-04-25T21:01:55.617855+0000 (oldest deadline 2024-04-25T21:02:20.917640+0000) 2024-04-25T21:02:39.343 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:38 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10[57102]: 2024-04-25T21:02:38.842+0000 7f2759932700 -1 osd.10 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.519187+0000 front 2024-04-25T21:02:05.519140+0000 (oldest deadline 2024-04-25T21:02:29.619082+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:39.555 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:39 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:39.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:40.196 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:39 smithi112 podman[69772]: 2024-04-25 21:02:39.916912467 +0000 UTC m=+5.562223526 container died 186e0c765547033a3a723aabe1152e375eae5a45202894647777dac68ce7d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True) 2024-04-25T21:02:40.538 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:40 smithi112 podman[69772]: 2024-04-25 21:02:40.287502981 +0000 UTC m=+5.932814093 container cleanup 186e0c765547033a3a723aabe1152e375eae5a45202894647777dac68ce7d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T21:02:40.539 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:40 smithi112 bash[69772]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:40.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:40 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:40.153+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:40.842 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:40 smithi112 podman[69790]: 2024-04-25 21:02:40.53922943 +0000 UTC m=+0.620071610 container remove 186e0c765547033a3a723aabe1152e375eae5a45202894647777dac68ce7d868 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T21:02:41.167 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:40 smithi112 podman[69884]: 2024-04-25 21:02:40.890077095 +0000 UTC m=+0.108029210 container create b4a9d239c023aa18a69b0486723ec3170f6976cbbb21c3cdb3a58221026e5415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:02:41.167 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:40 smithi112 podman[69884]: 2024-04-25 21:02:40.800043633 +0000 UTC m=+0.017995757 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:41.167 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:41 smithi112 podman[69884]: 2024-04-25 21:02:41.092476791 +0000 UTC m=+0.310428905 container init b4a9d239c023aa18a69b0486723ec3170f6976cbbb21c3cdb3a58221026e5415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T21:02:41.167 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:41 smithi112 podman[69884]: 2024-04-25 21:02:41.095659886 +0000 UTC m=+0.313612010 container start b4a9d239c023aa18a69b0486723ec3170f6976cbbb21c3cdb3a58221026e5415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS) 2024-04-25T21:02:41.167 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:41 smithi112 podman[69884]: 2024-04-25 21:02:41.167235693 +0000 UTC m=+0.385187809 container attach b4a9d239c023aa18a69b0486723ec3170f6976cbbb21c3cdb3a58221026e5415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:41.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:41 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:41.134+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:41.592 INFO:journalctl@ceph.osd.10.smithi112.stdout:Apr 25 21:02:41 smithi112 podman[69884]: 2024-04-25 21:02:41.383283623 +0000 UTC m=+0.601235739 container died b4a9d239c023aa18a69b0486723ec3170f6976cbbb21c3cdb3a58221026e5415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T21:02:41.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.10.service' 2024-04-25T21:02:42.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:42.051 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-25T21:02:42.051 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-25T21:02:42.051 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.11 2024-04-25T21:02:42.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 systemd[1]: Stopping Ceph osd.11 for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:42.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:42.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:42.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:42.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:42.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:42.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:42.342 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.129+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:42.841 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.377+0000 7f1faee7e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:42.841 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.377+0000 7f1faee7e700 -1 osd.11 105 *** Got signal Terminated *** 2024-04-25T21:02:42.841 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:42 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:42.377+0000 7f1faee7e700 -1 osd.11 105 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T21:02:43.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:43.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:43.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:43.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:43.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:43.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:43.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:43 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:43.158+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:44.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:44.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:44.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:44.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:44.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:44.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:44.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:44.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:44 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:44.151+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2024-04-25T21:02:18.562685+0000 front 2024-04-25T21:02:18.562749+0000 (oldest deadline 2024-04-25T21:02:43.862703+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:45.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:45 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:45.116+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2024-04-25T21:02:18.562685+0000 front 2024-04-25T21:02:18.562749+0000 (oldest deadline 2024-04-25T21:02:43.862703+0000) 2024-04-25T21:02:46.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:46.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:46.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:46.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:46.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:46.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:46.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:46.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:46 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:46.139+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2024-04-25T21:02:18.562685+0000 front 2024-04-25T21:02:18.562749+0000 (oldest deadline 2024-04-25T21:02:43.862703+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6806 osd.0 since back 2024-04-25T21:01:15.553605+0000 front 2024-04-25T21:01:15.553827+0000 (oldest deadline 2024-04-25T21:01:39.653793+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-04-25T21:01:23.055410+0000 front 2024-04-25T21:01:23.055297+0000 (oldest deadline 2024-04-25T21:01:47.155267+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2024-04-25T21:01:32.956686+0000 front 2024-04-25T21:01:32.956750+0000 (oldest deadline 2024-04-25T21:01:57.656891+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-04-25T21:01:48.258385+0000 front 2024-04-25T21:01:48.258354+0000 (oldest deadline 2024-04-25T21:02:12.358317+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2024-04-25T21:01:56.359814+0000 front 2024-04-25T21:01:56.359795+0000 (oldest deadline 2024-04-25T21:02:20.360505+0000) 2024-04-25T21:02:47.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.43:6822 osd.6 since back 2024-04-25T21:02:05.661664+0000 front 2024-04-25T21:02:05.661619+0000 (oldest deadline 2024-04-25T21:02:28.561586+0000) 2024-04-25T21:02:47.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-04-25T21:02:12.662608+0000 front 2024-04-25T21:02:12.662552+0000 (oldest deadline 2024-04-25T21:02:38.562351+0000) 2024-04-25T21:02:47.592 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11[58701]: 2024-04-25T21:02:47.189+0000 7f1fa746a700 -1 osd.11 105 heartbeat_check: no reply from 172.21.15.195:6820 osd.8 since back 2024-04-25T21:02:18.562685+0000 front 2024-04-25T21:02:18.562749+0000 (oldest deadline 2024-04-25T21:02:43.862703+0000) 2024-04-25T21:02:48.091 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:47 smithi195 podman[71380]: 2024-04-25 21:02:47.838562293 +0000 UTC m=+5.591677252 container died d10fe70d2aa717695d4160f28fc1cbf74f9826aa11a141321164f78b7a2384ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS) 2024-04-25T21:02:48.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71380]: 2024-04-25 21:02:48.178282229 +0000 UTC m=+5.931397175 container cleanup d10fe70d2aa717695d4160f28fc1cbf74f9826aa11a141321164f78b7a2384ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-25T21:02:48.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 bash[71380]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11 2024-04-25T21:02:48.591 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71397]: 2024-04-25 21:02:48.362542375 +0000 UTC m=+0.522721840 container remove d10fe70d2aa717695d4160f28fc1cbf74f9826aa11a141321164f78b7a2384ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-25T21:02:49.075 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71490]: 2024-04-25 21:02:48.690398024 +0000 UTC m=+0.018085307 image pull da4b004c09e820713483d039bc76fbd660be678f2ea3c03e059a6161b74dab76 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4 2024-04-25T21:02:49.075 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71490]: 2024-04-25 21:02:48.788475189 +0000 UTC m=+0.116162442 container create 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T21:02:49.075 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71490]: 2024-04-25 21:02:48.99184015 +0000 UTC m=+0.319527405 container init 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T21:02:49.075 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:48 smithi195 podman[71490]: 2024-04-25 21:02:48.994828766 +0000 UTC m=+0.322516016 container start 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.schema-version=1.0) 2024-04-25T21:02:49.075 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:49 smithi195 podman[71490]: 2024-04-25 21:02:49.075132512 +0000 UTC m=+0.402819791 container attach 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-25T21:02:49.341 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:49 smithi195 podman[71490]: 2024-04-25 21:02:49.285177058 +0000 UTC m=+0.612864315 container died 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T21:02:49.841 INFO:journalctl@ceph.osd.11.smithi195.stdout:Apr 25 21:02:49 smithi195 podman[71516]: 2024-04-25 21:02:49.821636146 +0000 UTC m=+0.530269217 container remove 05f344643534582e58c319e596cb2787554ce542260bdcfeb6e55c8ee0932a38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T21:02:49.850 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@osd.11.service' 2024-04-25T21:02:49.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:49.888 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-25T21:02:49.888 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-25T21:02:49.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.a 2024-04-25T21:02:50.190 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:49 smithi043 systemd[1]: Stopping Ceph mds.a for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:50.544 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:50 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: 2024-04-25T21:02:50.190+0000 7f693c2b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:50.544 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:50 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a[71976]: 2024-04-25T21:02:50.190+0000 7f693c2b9700 -1 mds.a *** got signal Terminated *** 2024-04-25T21:02:54.456 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 podman[99289]: 2024-04-25 21:02:54.19893866 +0000 UTC m=+4.109527911 container died f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-25T21:02:54.732 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 podman[99289]: 2024-04-25 21:02:54.547716068 +0000 UTC m=+4.458305324 container cleanup f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T21:02:54.732 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 bash[99289]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a 2024-04-25T21:02:54.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.a.service' 2024-04-25T21:02:54.999 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 podman[99303]: 2024-04-25 21:02:54.732102393 +0000 UTC m=+0.529070435 container remove f302bc12a12fea2d64ce44d874a51a54fd958223c4d64160dce4af894cfbded0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-25T21:02:54.999 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.a.service: Deactivated successfully. 2024-04-25T21:02:54.999 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 systemd[1]: Stopped Ceph mds.a for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T21:02:54.999 INFO:journalctl@ceph.mds.a.smithi043.stdout:Apr 25 21:02:54 smithi043 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.a.service: Consumed 3.500s CPU time. 2024-04-25T21:02:55.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:55.012 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-25T21:02:55.013 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-25T21:02:55.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.d 2024-04-25T21:02:55.294 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:55 smithi043 systemd[1]: Stopping Ceph mds.d for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:02:55.794 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d[70675]: 2024-04-25T21:02:55.467+0000 7fc047806700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:02:55.794 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:55 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d[70675]: 2024-04-25T21:02:55.467+0000 7fc047806700 -1 mds.d *** got signal Terminated *** 2024-04-25T21:02:58.968 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:58 smithi043 podman[99410]: 2024-04-25 21:02:58.703039585 +0000 UTC m=+3.471966860 container died af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:02:59.294 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:59 smithi043 podman[99410]: 2024-04-25 21:02:59.067608632 +0000 UTC m=+3.836535916 container cleanup af98139affe56afe2c6f2aa9c4b38f8b2b9034556230918a6394b433fc455558 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T21:02:59.294 INFO:journalctl@ceph.mds.d.smithi043.stdout:Apr 25 21:02:59 smithi043 bash[99410]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-d 2024-04-25T21:02:59.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.d.service' 2024-04-25T21:02:59.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:02:59.685 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-25T21:02:59.685 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-25T21:02:59.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.g 2024-04-25T21:03:00.021 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:02:59 smithi043 systemd[1]: Stopping Ceph mds.g for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:00.294 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:03:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: 2024-04-25T21:03:00.021+0000 7f9396f5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:00.294 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:03:00 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g[71514]: 2024-04-25T21:03:00.021+0000 7f9396f5b700 -1 mds.g *** got signal Terminated *** 2024-04-25T21:03:02.505 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:03:02 smithi043 podman[99529]: 2024-04-25 21:03:02.2384394 +0000 UTC m=+2.322780243 container died 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T21:03:02.794 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:03:02 smithi043 podman[99529]: 2024-04-25 21:03:02.713625167 +0000 UTC m=+2.797966009 container cleanup 7ff145139d213275b04808260adc84b9b35c7b4f720f0aa8aa0579187e76f2fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T21:03:02.794 INFO:journalctl@ceph.mds.g.smithi043.stdout:Apr 25 21:03:02 smithi043 bash[99529]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-g 2024-04-25T21:03:03.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.g.service' 2024-04-25T21:03:03.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:03.186 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-25T21:03:03.186 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-25T21:03:03.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.j 2024-04-25T21:03:03.525 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:03 smithi043 systemd[1]: Stopping Ceph mds.j for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:03.794 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j[70259]: 2024-04-25T21:03:03.524+0000 7f45ca760700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:03.794 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:03 smithi043 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j[70259]: 2024-04-25T21:03:03.524+0000 7f45ca760700 -1 mds.j *** got signal Terminated *** 2024-04-25T21:03:07.044 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:06 smithi043 podman[99650]: 2024-04-25 21:03:06.783646234 +0000 UTC m=+3.367391137 container died 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-25T21:03:07.376 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:07 smithi043 podman[99650]: 2024-04-25 21:03:07.158861713 +0000 UTC m=+3.742606624 container cleanup 4afa2628f46e2a246b8bfa8e573287fb38562424c8c3023a184fa9b40e87dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:07.376 INFO:journalctl@ceph.mds.j.smithi043.stdout:Apr 25 21:03:07 smithi043 bash[99650]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-j 2024-04-25T21:03:07.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.j.service' 2024-04-25T21:03:07.529 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:07.529 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-25T21:03:07.529 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-25T21:03:07.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.b 2024-04-25T21:03:07.838 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:07 smithi112 systemd[1]: Stopping Ceph mds.b for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:08.092 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: 2024-04-25T21:03:07.838+0000 7f6e33036700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:08.092 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:07 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b[62603]: 2024-04-25T21:03:07.838+0000 7f6e33036700 -1 mds.b *** got signal Terminated *** 2024-04-25T21:03:10.592 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:10 smithi112 podman[69992]: 2024-04-25 21:03:10.22831379 +0000 UTC m=+2.500848017 container died ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T21:03:11.092 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:10 smithi112 podman[69992]: 2024-04-25 21:03:10.904858737 +0000 UTC m=+3.177392963 container cleanup ebebc2079ac5a29674746da2c6a566469195e95e4d3ba35d5e2a4cbc813d7b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD) 2024-04-25T21:03:11.092 INFO:journalctl@ceph.mds.b.smithi112.stdout:Apr 25 21:03:10 smithi112 bash[69992]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-b 2024-04-25T21:03:11.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.b.service' 2024-04-25T21:03:11.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:11.369 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-25T21:03:11.370 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-25T21:03:11.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.e 2024-04-25T21:03:11.692 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:11 smithi112 systemd[1]: Stopping Ceph mds.e for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:12.092 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e[61992]: 2024-04-25T21:03:11.691+0000 7f6046961700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:12.092 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:11 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e[61992]: 2024-04-25T21:03:11.691+0000 7f6046961700 -1 mds.e *** got signal Terminated *** 2024-04-25T21:03:14.510 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:14 smithi112 podman[70125]: 2024-04-25 21:03:14.227715245 +0000 UTC m=+2.640925290 container died 81d3c9031518250fe7571cf57ebd63dcbb885082277189926956f7f6735a5620 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-25T21:03:14.842 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:14 smithi112 podman[70125]: 2024-04-25 21:03:14.60911743 +0000 UTC m=+3.022327486 container cleanup 81d3c9031518250fe7571cf57ebd63dcbb885082277189926956f7f6735a5620 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:03:14.842 INFO:journalctl@ceph.mds.e.smithi112.stdout:Apr 25 21:03:14 smithi112 bash[70125]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-e 2024-04-25T21:03:15.028 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.e.service' 2024-04-25T21:03:15.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:15.060 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-25T21:03:15.060 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-25T21:03:15.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.h 2024-04-25T21:03:15.592 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:15 smithi112 systemd[1]: Stopping Ceph mds.h for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:15.592 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h[62301]: 2024-04-25T21:03:15.370+0000 7fa58db17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:15.592 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:15 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h[62301]: 2024-04-25T21:03:15.370+0000 7fa58db17700 -1 mds.h *** got signal Terminated *** 2024-04-25T21:03:18.479 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 podman[70247]: 2024-04-25 21:03:18.227673288 +0000 UTC m=+2.949594537 container died ac4d2d285f37025356e04c8f26bf79cf8aa0cbc0f287d36e2736239c9ad89c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d) 2024-04-25T21:03:18.755 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 podman[70247]: 2024-04-25 21:03:18.554489088 +0000 UTC m=+3.276410335 container cleanup ac4d2d285f37025356e04c8f26bf79cf8aa0cbc0f287d36e2736239c9ad89c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-d69f13d, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-25T21:03:18.755 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 bash[70247]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h 2024-04-25T21:03:18.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.h.service' 2024-04-25T21:03:19.015 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 podman[70261]: 2024-04-25 21:03:18.755753425 +0000 UTC m=+0.524590427 container remove ac4d2d285f37025356e04c8f26bf79cf8aa0cbc0f287d36e2736239c9ad89c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-25T21:03:19.015 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.h.service: Deactivated successfully. 2024-04-25T21:03:19.015 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 systemd[1]: Stopped Ceph mds.h for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T21:03:19.015 INFO:journalctl@ceph.mds.h.smithi112.stdout:Apr 25 21:03:18 smithi112 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.h.service: Consumed 34.540s CPU time. 2024-04-25T21:03:19.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:19.025 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-25T21:03:19.026 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-25T21:03:19.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.k 2024-04-25T21:03:19.341 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:19 smithi112 systemd[1]: Stopping Ceph mds.k for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:19.592 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: 2024-04-25T21:03:19.341+0000 7f7302be8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:19.592 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:19 smithi112 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k[61671]: 2024-04-25T21:03:19.341+0000 7f7302be8700 -1 mds.k *** got signal Terminated *** 2024-04-25T21:03:22.492 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 podman[70368]: 2024-04-25 21:03:22.230929077 +0000 UTC m=+2.994548170 container died d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:22.750 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 podman[70368]: 2024-04-25 21:03:22.566746634 +0000 UTC m=+3.330365722 container cleanup d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T21:03:22.751 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 bash[70368]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k 2024-04-25T21:03:22.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.k.service' 2024-04-25T21:03:23.009 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 podman[70380]: 2024-04-25 21:03:22.751209096 +0000 UTC m=+0.514688186 container remove d63ff1abad020604296f28b31429be1ef900a7f1b0974c35074c32946fc1701a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:23.009 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.k.service: Deactivated successfully. 2024-04-25T21:03:23.009 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 systemd[1]: Stopped Ceph mds.k for 92e6f50e-0343-11ef-bc93-c7b262605968. 2024-04-25T21:03:23.009 INFO:journalctl@ceph.mds.k.smithi112.stdout:Apr 25 21:03:22 smithi112 systemd[1]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.k.service: Consumed 5.456s CPU time. 2024-04-25T21:03:23.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:23.020 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-25T21:03:23.020 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-25T21:03:23.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.c 2024-04-25T21:03:23.341 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:23 smithi195 systemd[1]: Stopping Ceph mds.c for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:23.596 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c[64023]: 2024-04-25T21:03:23.437+0000 7fae7b681700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:23.597 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:23 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c[64023]: 2024-04-25T21:03:23.437+0000 7fae7b681700 -1 mds.c *** got signal Terminated *** 2024-04-25T21:03:26.556 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:26 smithi195 podman[71596]: 2024-04-25 21:03:26.236603621 +0000 UTC m=+3.026311311 container died ff7137b97844304a911a2bdd7339588e21c461fc97e0d0d3d0ca835b8c1c85c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:26.841 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:26 smithi195 podman[71596]: 2024-04-25 21:03:26.655074834 +0000 UTC m=+3.444782524 container cleanup ff7137b97844304a911a2bdd7339588e21c461fc97e0d0d3d0ca835b8c1c85c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:26.841 INFO:journalctl@ceph.mds.c.smithi195.stdout:Apr 25 21:03:26 smithi195 bash[71596]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-c 2024-04-25T21:03:27.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.c.service' 2024-04-25T21:03:27.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:27.115 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-25T21:03:27.115 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-25T21:03:27.115 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.f 2024-04-25T21:03:27.442 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:27 smithi195 systemd[1]: Stopping Ceph mds.f for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:27.841 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: 2024-04-25T21:03:27.441+0000 7fd4d2d8c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:27.841 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:27 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f[63713]: 2024-04-25T21:03:27.441+0000 7fd4d2d8c700 -1 mds.f *** got signal Terminated *** 2024-04-25T21:03:30.567 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:30 smithi195 podman[71731]: 2024-04-25 21:03:30.233572816 +0000 UTC m=+2.893190190 container died 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T21:03:30.567 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:30 smithi195 podman[71731]: 2024-04-25 21:03:30.567074548 +0000 UTC m=+3.226691928 container cleanup 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:30.841 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:30 smithi195 bash[71731]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f 2024-04-25T21:03:30.841 INFO:journalctl@ceph.mds.f.smithi195.stdout:Apr 25 21:03:30 smithi195 podman[71745]: 2024-04-25 21:03:30.74322227 +0000 UTC m=+0.511641923 container remove 7de9ab3d0fe7cbf3a9674183f378496fe3e4db73bdbe42582295aff0f6740657 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-25T21:03:30.984 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.f.service' 2024-04-25T21:03:31.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:31.017 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-25T21:03:31.017 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-25T21:03:31.018 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.i 2024-04-25T21:03:31.329 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:31 smithi195 systemd[1]: Stopping Ceph mds.i for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:31.591 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: 2024-04-25T21:03:31.328+0000 7f93034a0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:31.591 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:31 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i[64331]: 2024-04-25T21:03:31.328+0000 7f93034a0700 -1 mds.i *** got signal Terminated *** 2024-04-25T21:03:34.341 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:34 smithi195 podman[71850]: 2024-04-25 21:03:34.23091576 +0000 UTC m=+3.000327250 container died 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-d69f13d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:34.841 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:34 smithi195 podman[71850]: 2024-04-25 21:03:34.579110479 +0000 UTC m=+3.348521967 container cleanup 2f463b54da63e4ed5303c05f5384f11858160bcdac1c575ff00f75a9db183339 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T21:03:34.841 INFO:journalctl@ceph.mds.i.smithi195.stdout:Apr 25 21:03:34 smithi195 bash[71850]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-i 2024-04-25T21:03:34.992 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.i.service' 2024-04-25T21:03:35.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:35.023 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-25T21:03:35.023 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-25T21:03:35.023 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.l 2024-04-25T21:03:35.332 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:35 smithi195 systemd[1]: Stopping Ceph mds.l for 92e6f50e-0343-11ef-bc93-c7b262605968... 2024-04-25T21:03:35.591 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: 2024-04-25T21:03:35.332+0000 7fbae6657700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T21:03:35.591 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:35 smithi195 ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l[63394]: 2024-04-25T21:03:35.332+0000 7fbae6657700 -1 mds.l *** got signal Terminated *** 2024-04-25T21:03:38.523 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:38 smithi195 podman[71971]: 2024-04-25 21:03:38.233400362 +0000 UTC m=+2.994316684 container died cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-d69f13d, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-25T21:03:38.523 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:38 smithi195 podman[71971]: 2024-04-25 21:03:38.523994653 +0000 UTC m=+3.284910972 container cleanup cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-d69f13d, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T21:03:38.841 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:38 smithi195 bash[71971]: ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l 2024-04-25T21:03:38.841 INFO:journalctl@ceph.mds.l.smithi195.stdout:Apr 25 21:03:38 smithi195 podman[71985]: 2024-04-25 21:03:38.733392669 +0000 UTC m=+0.497210788 container remove cda06cd8fbffb2c320c89e8ee2011659ff927d7cbbd5e7ca40e39c3576506e88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:068a558e3af4932cf1c60dd321c0bdf500075eb52ea1bf455e0973ba114fbfd4, name=ceph-92e6f50e-0343-11ef-bc93-c7b262605968-mds-l, RELEASE=wip-lusov-quiescer-d69f13d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T21:03:38.868 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-92e6f50e-0343-11ef-bc93-c7b262605968@mds.l.service' 2024-04-25T21:03:38.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T21:03:38.899 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-25T21:03:38.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T21:03:39.100 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:03:41.645 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T21:03:41.834 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:03:44.219 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T21:03:44.403 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:03:46.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:03:46.739 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:03:46.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T21:03:46.796 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T21:03:46.799 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi043/crash 2024-04-25T21:03:46.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash -- . 2024-04-25T21:03:46.827 INFO:teuthology.orchestra.run.smithi043.stderr:tar: /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T21:03:46.828 INFO:teuthology.orchestra.run.smithi043.stderr:tar: Error is not recoverable: exiting now 2024-04-25T21:03:46.830 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi112/crash 2024-04-25T21:03:46.830 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash -- . 2024-04-25T21:03:46.874 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T21:03:46.874 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-04-25T21:03:46.876 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi195/crash 2024-04-25T21:03:46.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash -- . 2024-04-25T21:03:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T21:03:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-04-25T21:03:46.917 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T21:03:46.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T21:03:46.955 INFO:tasks.cephadm:Compressing logs... 2024-04-25T21:03:46.955 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T21:03:46.998 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T21:03:47.001 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T21:03:47.022 INFO:teuthology.orchestra.run.smithi043.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-04-25T21:03:47.022 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log 2024-04-25T21:03:47.023 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T21:03:47.024 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-25T21:03:47.024 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-25T21:03:47.024 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T21:03:47.024 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T21:03:47.035 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log 2024-04-25T21:03:47.035 INFO:teuthology.orchestra.run.smithi195.stderr:: No such file or directory 2024-04-25T21:03:47.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T21:03:47.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.z.log: 87.6% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.i.log: 90.5% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T21:03:47.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr: 87.6% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.a.log: 90.3% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log: 84.4% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr: 94.7% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-25T21:03:47.037 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-25T21:03:47.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.11.log: 92.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-25T21:03:47.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T21:03:47.042 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log: No such file or directory 2024-04-25T21:03:47.042 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.y.log: 87.6%gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.5% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.10.log: 92.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T21:03:47.043 INFO:teuthology.orchestra.run.smithi112.stderr: 84.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T21:03:47.044 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-25T21:03:47.049 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.d.log: 94.5%gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T21:03:47.051 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.9.log: -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-25T21:03:47.053 INFO:teuthology.orchestra.run.smithi043.stderr: 91.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T21:03:47.053 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-25T21:03:47.057 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-25T21:03:47.065 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-25T21:03:47.066 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T21:03:47.067 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.b.log: 91.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T21:03:47.077 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T21:03:47.079 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/cephadm.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T21:03:47.081 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T21:03:47.082 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T21:03:47.097 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T21:03:47.413 INFO:teuthology.orchestra.run.smithi043.stderr: 90.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-25T21:03:47.424 INFO:teuthology.orchestra.run.smithi195.stderr: 92.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-25T21:03:47.496 INFO:teuthology.orchestra.run.smithi043.stderr: 95.2% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-25T21:03:47.504 INFO:teuthology.orchestra.run.smithi112.stderr: 91.7% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-25T21:03:47.559 INFO:teuthology.orchestra.run.smithi043.stderr: 95.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-25T21:03:47.714 INFO:teuthology.orchestra.run.smithi195.stderr: 95.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-25T21:03:48.316 INFO:teuthology.orchestra.run.smithi043.stderr: 90.3% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-25T21:03:48.625 INFO:teuthology.orchestra.run.smithi112.stderr: 95.3% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-25T21:03:49.089 INFO:teuthology.orchestra.run.smithi112.stderr: 95.1% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-25T21:03:50.965 INFO:teuthology.orchestra.run.smithi043.stderr: 91.8% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-25T21:03:52.158 INFO:teuthology.orchestra.run.smithi043.stderr: 91.6% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-25T21:03:52.694 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-25T21:03:52.698 INFO:teuthology.orchestra.run.smithi195.stderr: 93.6% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-25T21:03:52.750 INFO:teuthology.orchestra.run.smithi043.stderr: 91.8% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T21:03:52.896 INFO:teuthology.orchestra.run.smithi112.stderr: 91.7% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T21:03:53.110 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T21:03:53.347 INFO:teuthology.orchestra.run.smithi043.stderr: 91.7% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T21:03:53.349 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-04-25T21:03:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m6.337s 2024-04-25T21:03:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m23.094s 2024-04-25T21:03:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.695s 2024-04-25T21:03:53.369 INFO:teuthology.orchestra.run.smithi112.stderr: 92.0% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-25T21:03:53.477 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-25T21:03:53.780 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-25T21:03:53.974 INFO:teuthology.orchestra.run.smithi195.stderr: 91.7% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T21:03:54.013 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-25T21:03:54.106 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-25T21:03:54.107 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-25T21:03:54.107 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m7.093s 2024-04-25T21:03:54.107 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m45.317s 2024-04-25T21:03:54.107 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m1.271s 2024-04-25T21:03:54.263 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T21:03:59.927 INFO:teuthology.orchestra.run.smithi112.stderr: 93.2% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-25T21:04:06.846 INFO:teuthology.orchestra.run.smithi112.stderr: 93.4% -- replaced with /var/log/ceph/92e6f50e-0343-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-25T21:04:06.847 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-04-25T21:04:06.848 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m19.833s 2024-04-25T21:04:06.848 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m59.579s 2024-04-25T21:04:06.848 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m1.781s 2024-04-25T21:04:06.848 INFO:tasks.cephadm:Archiving logs... 2024-04-25T21:04:06.848 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi043/log 2024-04-25T21:04:06.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T21:04:10.516 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi112/log 2024-04-25T21:04:10.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T21:04:18.573 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi195/log 2024-04-25T21:04:18.574 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T21:04:24.193 INFO:tasks.cephadm:Removing cluster... 2024-04-25T21:04:24.194 DEBUG:teuthology.orchestra.run.smithi043:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force 2024-04-25T21:04:24.396 INFO:teuthology.orchestra.run.smithi043.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:04:24.701 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force 2024-04-25T21:04:24.893 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:04:25.209 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 92e6f50e-0343-11ef-bc93-c7b262605968 --force 2024-04-25T21:04:25.390 INFO:teuthology.orchestra.run.smithi195.stdout:Deleting cluster with fsid: 92e6f50e-0343-11ef-bc93-c7b262605968 2024-04-25T21:04:25.708 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T21:04:25.709 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T21:04:25.728 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T21:04:25.743 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T21:04:25.759 INFO:tasks.cephadm:Teardown complete 2024-04-25T21:04:25.759 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T21:04:25.772 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T21:04:25.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T21:04:25.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T21:04:25.786 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T21:04:25.895 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T21:04:25.906 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T21:04:25.907 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:04:25.909 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:04:25.912 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T21:04:25.924 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-04-25T21:04:25.924 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-04-25T21:04:25.925 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +461us[ +484us] +/- 56ms 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -1223us[-1223us] +/- 63ms 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +792us[ +792us] +/- 70ms 2024-04-25T21:04:25.929 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +467us[ +472us] +/- 56ms 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -1210us[-1204us] +/- 63ms 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +785us[ +791us] +/- 70ms 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T21:04:25.931 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T21:04:25.932 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-25T21:04:25.932 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +481us[ +492us] +/- 56ms 2024-04-25T21:04:25.932 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1186us[-1175us] +/- 63ms 2024-04-25T21:04:25.932 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +770us[ +781us] +/- 70ms 2024-04-25T21:04:25.932 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T21:04:25.932 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T21:04:25.944 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T21:04:25.945 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T21:04:25.957 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T21:04:26.056 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T21:04:26.121 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T21:04:26.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T21:04:26.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:26.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T21:04:26.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:26.241 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T21:04:26.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:26.267 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T21:04:26.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T21:04:26.290 INFO:teuthology.task.internal:Duration was 1986.905861 seconds 2024-04-25T21:04:26.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T21:04:26.303 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T21:04:26.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T21:04:26.305 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T21:04:26.308 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T21:04:26.341 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T21:04:26.343 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T21:04:26.344 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T21:04:26.635 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T21:04:26.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-25T21:04:26.635 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T21:04:26.657 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-25T21:04:26.657 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T21:04:26.695 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-25T21:04:26.695 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T21:04:26.724 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T21:04:26.724 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T21:04:26.727 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T21:04:26.737 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T21:04:26.789 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T21:04:26.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T21:04:26.794 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T21:04:26.801 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T21:04:27.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T21:04:27.457 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T21:04:27.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T21:04:27.481 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T21:04:27.505 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T21:04:27.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T21:04:27.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.549 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.551 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.569 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-25T21:04:27.571 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-25T21:04:27.595 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-25T21:04:27.635 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:27.650 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:27.665 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T21:04:27.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T21:04:27.690 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T21:04:27.705 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T21:04:27.705 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi043 2024-04-25T21:04:27.706 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T21:04:27.754 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi112 2024-04-25T21:04:27.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T21:04:27.789 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_19:59:35-fs-wip-lusov-quiescer-distro-default-smithi/7673646/remote/smithi195 2024-04-25T21:04:27.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T21:04:27.826 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T21:04:27.826 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T21:04:27.829 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T21:04:27.831 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T21:04:27.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T21:04:27.897 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T21:04:27.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T21:04:27.913 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T21:04:27.914 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T21:04:27.916 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T21:04:27.918 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T21:04:27.928 INFO:teuthology.orchestra.run.smithi043.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 21:04 /home/ubuntu/cephtest 2024-04-25T21:04:27.931 INFO:teuthology.orchestra.run.smithi112.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 21:04 /home/ubuntu/cephtest 2024-04-25T21:04:27.934 INFO:teuthology.orchestra.run.smithi195.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 21:04 /home/ubuntu/cephtest 2024-04-25T21:04:27.935 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T21:04:27.951 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T21:04:27.984 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1986.9058606624603 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-25T21:04:27.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T21:04:28.076 INFO:teuthology.run:pass